Dishes: a restaurant-oriented food dataset

Conventional food recognition datasets only include food images and food categories. In contrast, Dishes is a restaurant-oriented dataset suitable to study both visual and context-based food recognition. The dataset consists of dish (i.e. food category in a restaurant menu) images augmented with restaurant information. This information includes the geographic location of the restaurant and the menu (i.e. dish categories in that restaurant).

Yummly-28K: a multimodal recipe dataset

A recipe-oriented dataset for multimodal food analysis collected from Yummly. In addition to images, it includes name of the recipe, ingredients, cuisine and course type. It has been used to evaluate multimodal recipe retrieval, ingredient inference and cuisine classification.