FAHALWAYS / THREE-CASE PAID PILOT
Test the work your AI needs to get right.
Commission three evaluation cases around one agreed workflow. Receive realistic assignments, source files, reference deliverables, and scoring materials your team can use to assess completed work.
Request a pilot scopeDownload the sample preview (PDF)The two-page public preview includes a synthetic assignment, abbreviated evidence, a deliverable excerpt, and assessment categories. Complete cases and detailed scoring remain private.
Choose the pilot that fits your team
Model, agent, and evaluation-data teams
Add expert-authored task environments that test evidence use, technical problem-solving, and workflow completion. Agree the target capability, difficulty, runtime needs, and acceptance criteria before development.
Watch the data-pipeline repair exampleBusinesses evaluating an AI workflow
Check whether an assistant or agent uses the right records, reconciles discrepancies, and recognizes when a person must decide. Start with a workflow your team can clearly describe and review.
Watch the business-workflow exampleWhat you receive
- Three distinct cases: assignments and realistic source materials for one agreed workflow, with a case mix chosen around the failures that matter.
- Reference deliverables: examples of the expected completed work, delivered separately from model-facing materials.
- Scoring rubrics: evidence-linked criteria for assessing correctness, completeness, and critical errors.
- Usage guidance and handoff: package organization, instructions for use, and a discussion of the agreed deliverables.
PDF, CSV, spreadsheet, document, and code materials are selected to fit the task. Executable environments, automated checks, evaluation-platform adapters, and specialized file formats are included only when specified in the written scope.
What your team supplies
A description of the AI system and its intended job; representative inputs and expected outputs; important failure modes; tool and environment constraints; and a reviewer who can confirm the scope. Begin with a high-level description. Synthetic or rights-cleared materials can be used without live customer data.
How delivery and acceptance work
- Scope: agree the workflow, three-case coverage, deliverables, formats, rights, review rounds, milestones, and acceptance criteria.
- Develop and review: prepare the cases and reference materials; check that each task can be completed from the supplied evidence and that criteria match the assignment.
- Handoff: deliver the agreed package privately, address the scoped review feedback, and walk your team through its use.
Who runs and scores the AI?
The core pilot supplies evaluation materials. Your team runs its own system and assesses the outputs. If you need FAHALWAYS to run models, score outputs, compare versions, or prepare a findings report, request those services in the scope. Results apply to the tested cases and conditions.
Timing, pricing, and usage rights
Each pilot is quoted after reviewing the workflow and technical requirements. The proposal specifies the delivery schedule, client dependencies, review rounds, and price before work begins. It also defines internal use, redistribution, exclusivity, ownership, and any licensing restrictions.
Confidentiality, secure transfer, access, retention, deletion, and third-party processing requirements are agreed before confidential source files are exchanged.
Evaluation pilot or implementation pilot?
An evaluation pilot creates the tasks and scoring materials used to assess AI. An implementation pilot builds or integrates an AI solution. We can discuss both through a coordinated, separately scoped engagement.
Request a pilot scopeShare your organization, target workflow, the support you need, and your timing. Please do not include confidential source files in your initial inquiry.