Food recognition from photo
Identify foods and portions from an image. Returns foods, portions, nutrients.
DocsPlatform
The platform behind a nutrition experience.
Recognize food, interpret it against the context you send, and return a result your application can show or act on. APIs, SDKs, and Passio AI Studio are how a team uses the same platform.
Your experience
Food input and the context your application, service or workflow already has
Passio
Food understanding, nutrition intelligence and configured workflow logic
Back to you
Structured results your team displays, routes or acts on
Scan, understand, decide, act, learn
1
Scan
A photo, barcode, nutrition label, voice note, or typed meal.
2
Understand
Foods, portions, and nutrients as structured records.
3
Decide
Guidance, a rating, menu picks, or a meal plan, using the context you send.
4
Act
A substitute, a US shopping link, or a result your application shows.
5
Learn
Your application reports what happened next. Passio does not change the workflow on its own.
What the API accepts
These routes identify food. Meal planning, the nutrition advisor, ratings, and menu guidance are separate routes. They are not inputs.
Voice and text meal logging
Parse spoken or typed meals into foods and portions. Returns foods, portions, nutrients.
DocsBarcode and nutrition-label lookup
Resolve packaged products across multiple data sources. Returns product, nutrients.
DocsSemantic food search with tag filters
Search by name, diet, allergen or claim. Returns ranked foods.
DocsIntelligence, then the workflow
Recognition produces the food record. The advisor, ratings, meal plans, and menu guidance interpret that context. Passio AI Studio is where a team configures knowledge and endpoints the standard routes do not cover. Provider summaries are not a standard API.
PreferenceVegetarian
Explore meal ideas that fit your preferences.
The application sends the preference. The response is the workflow you configured, for the member to review.
Why this suggestion · Illustrative
- Step 1Nutrition dataFoods, portions and nutrients from Passio's database
- Step 2AI interpretationA route reads that data with the context you send
- Step 3Your workflowPassio AI Studio adds your knowledge and rules
- Step 4Application outputStructured JSON your app shows or acts on
APIs and SDKs
Call the REST API from your server, or use the mobile SDKs for iOS, Android, React Native and Flutter. One account key covers the API, the SDKs and Passio AI Studio. Keep the key on your server.
Capability catalog
| Capability | Inputs | Returns | Docs |
|---|---|---|---|
Food recognition from photo Identify foods and portions from an image. | image | foods, portions, nutrients | Docs |
Voice and text meal logging Parse spoken or typed meals into foods and portions. | audio, text | foods, portions, nutrients | Docs |
Barcode and nutrition-label lookup Resolve packaged products across multiple data sources. | barcode, image | product, nutrients | Docs |
Semantic food search with tag filters Search by name, diet, allergen or claim. | text | ranked foods | Docs |
Nutrition advisor Ask a nutrition question, with optional context such as goals or restrictions, and receive guidance. The response can include linked food references. | text | guidance | Docs |
Rate a food against a criterion Send a food and a criterion. The API returns a numeric rating and an explanation. A separate route rates how ultra-processed a named food is. | text | rating, explanation | Docs |
Grocery replacements Credible substitutes in the same usage context, with images. | product | substitutes, images, links | Docs |
Instacart shopping links with attribution Generate tracked shopping links; purchases attributed to the customer account. | products | tracked link | Docs |
Meal planning A multi-day plan with recipes, Passio-linked ingredients, macro totals and an optional PDF, from a description of goals and restrictions. Five plan types: fast, macro-tuned, budget, athletic and family. | profile | plan | Docs |
Menu guidance From a menu photo, menu text, or restaurant name, plus goals and restrictions, return ranked picks, items to avoid, and tips. Nutrition figures in that response are estimates, not Passio food records. | menu, preferences | picks, avoid, tips | Docs |
Translation and regional recognition Translation of names and portions; regional context so local dishes are recognized. | — | — | Docs |
Model choice per request with fallback On Growth and Pro, choose the model per request. Automatic fallback applies, and the response names the model used. With Zero Data Retention on, routing is limited to the Vertex-hosted models named on the Trust page. | — | — | Docs |
Passio AI Studio: Integrate REST and mobile SDK assistants that scaffold and troubleshoot integrations. | prompt | code | Docs |
Passio AI Studio: Configure Functions and chains from plain English; versioning, retries, fallbacks. | prompt | endpoint | — |
Passio AI Studio: Build an app Preview a nutrition workflow and export the integration. This is not a general-purpose app builder. | prompt | app | — |
Every capability is on every plan. Plans differ in included tokens, refill price, usage insights, and choosing the model per request (Growth and Pro).
Model choice on Growth and Pro: On Growth and Pro, choose the model per request. Automatic fallback applies, and the response names the model used. With Zero Data Retention on, routing is limited to the Vertex-hosted models named on the Trust page.
Start with the platform.
Last reviewed 2026-10-22