Research notes

Practical methods for AI research.

Practical guides for teams deciding what to investigate, how to test it and what a result can reasonably support.

A feasibility diagram connecting the task and available material to a test and a proceed, narrow or stop decision
From question to decision · Concept diagramDefine the task and available material, identify constraints, and decide whether a focused test is justified.
A feasibility diagram connecting the task and available material to a test and a proceed, narrow or stop decision
From question to decision · Concept diagram

What should an AI feasibility study establish?

A framework for defining the decision, examining data and identifying the smallest useful experiment.

Read the guide
Concept interface connecting sample business data to a prototype and review queue
Sample, prototype, review · AI-generated concept illustration

How to define proof-of-concept success

Set hypotheses, baselines and stop criteria before a demonstration becomes the definition of success.

Read the guide
A diagram separating answer claims with source support from claims without it
Check the support for each claim · Concept diagram

How to evaluate LLM answers

Separate correctness, evidence support and knowing when to say it is not sure, then examine the failures behind an overall score.

Read the guide

Methods to adapt to your task.

These guides describe proposed working methods, not findings from completed Manas Labs benchmarks. Their purpose is to help a team frame a useful investigation and recognise the limits of its evidence.

There is no universal threshold for an acceptable AI result. The task, available material, consequences of error and intended human review all influence what should be measured. A research brief makes those choices explicit before results are interpreted.

We link to primary sources where they support the discussion. External frameworks and research provide context; they do not certify an engagement or establish the performance of a particular system.

Use the guides as a starting brief.

Write down the decision you need to make, an example of a useful output and an example of an unacceptable one. Identify the information the model would be allowed to use. Then ask what evidence would persuade you to proceed, revise the approach or stop.

If you cannot yet answer those questions, that uncertainty is itself useful scoping information. It may indicate that the next step is problem definition or data investigation rather than another prototype.

For a scoped investigation, explore AI Research & Feasibility, AI Proof of Concept or Model Evaluation & Benchmarking. Our research process explains how the question becomes an agreed engagement.

A considered next step

What do you need to find out?
Start with the question.

Tell us the task, the material available and the decision you need to make. We will discuss whether a focused investigation is the right next step.

Discuss your question hi@manaslabs.co.uk
01   Describe the task02   Agree the investigation03   Review the evidence