KUSK Dataset: 2014RC

Citing this dataset

@inproceedings{kuskdataset_2014rc,
  title = "{KUSK Dataset}: Toward a Direct Understanding of Recipe Text and Human Cooking Activity",
  author = "Hashimoto, Atsushi and Tetsuro, Sasada and Yamakata, Yoko and Mori, Shinsuke and Minoh, Michihiko",
  booktitle = "Workshop on Smart Technology for Cooking and Eating Activities",
  pages = {583-588},
  year={2014},
}

How to access the locked data

To access the data marked up by in its 'Auth.' field, you need to fill up online application form .
You can access the data with without signing the form, but still need to follow the Terms and Conditions .

Recipe

In all the experiments, we used CHIFFON to show the recipes. The recipes are all written in Japanese originally, and some are translated in English by COOKPAD.
(We understand that currently only RC04 are published in English.)
The recipe converted into HWML for the CHIFFON system are linked as recipe.xml.

Notes

  1. Some data are obtained but in very low and unstable sampling rate due because of a trouble in strage speed. If you do not care about sampling rate, all the low quality data is available here.
  2. Because of privacy problems, cameraD data atlocked subjects are treated strictly. You can offer them via e-mail.
  3. Click the table header to know the data formats.

Updates

  • 2015.09.24: The following data were added.
    2014RC03_S034, 2014RC04_S035, 2014RC05_S034, 2014RC06_S033, 2014RC07_S029, 2014RC07_S030, 2014RC08_S032, 2014RC10_S028, 2014RC11_S030, 2014RC13_S032, 2014RC14_S031, 2014RC15_S028, 2014RC18_S031
  • 2015.01.26: The data with any lack of Flycapture Camera data was moved to 2014RC_low_quality
  • 2014.12.20: All the data of low quality sampling rate was moved to 2014RC_low_quality
  • 2014.10.3: Two broken videos were replaced to valid format videos (cameraB_2014RC05_S018.mp4 and cameraB_2014RC09_S010.mp4)
  • 2014.10.2: Unmatched filename/contents problem of Camera is fixed.
  • 2014.10.2: 2014RC13_S012 is deleted because no data were captured properly.

Data Table

Auth. ID Chiffon Log Camera Kinect Thermal Camera Load Sensor Water Flow Eye Tracker Ele. Comsumption
2014RC01_S020chiffon.log
original-recipe_en
original-recipe_jp
recipe.xml
cameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
camera.txt
color.mp4
depth.mov
timestamp.csv
thermo.7z
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC02_S022chiffon.log
original-recipe_en
original-recipe_jp
recipe.xml
cameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
camera.txt
color.mp4
depth.mov
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC03_S034No DatacameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
cameraD.mp4
cameraD.csv
camera.txt
color.mp4
depth.mov
images.csv
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC04_S017chiffon.log
original-recipe_en
original-recipe_jp
recipe.xml
cameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
camera.txt
color.mp4
depth.mov
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC04_S035No DatacameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
cameraD.mp4
cameraD.csv
camera.txt
color.mp4
depth.mov
images.csv
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC05_S034No DatacameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
cameraD.mp4
cameraD.csv
camera.txt
color.mp4
depth.mov
images.csv
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC06_S033No DatacameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
cameraD.mp4
cameraD.csv
camera.txt
color.mp4
depth.mov
images.csv
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC07_S029No DatacameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
cameraD.mp4
cameraD.csv
camera.txt
color.mp4
depth.mov
images.csv
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC07_S030No DatacameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
cameraD.mp4
cameraD.csv
camera.txt
color.mp4
depth.mov
images.csv
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC08_S032No DatacameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
cameraD.mp4
cameraD.csv
camera.txt
color.mp4
depth.mov
images.csv
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC09_S022chiffon.log
original-recipe_en
original-recipe_jp
recipe.xml
cameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
camera.txt
color.mp4
depth.mov
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC10_S028No DatacameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
cameraD.mp4
cameraD.csv
camera.txt
color.mp4
depth.mov
images.csv
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
No Datawater.csvNo Dataelectricity.csv
2014RC11_S030No DatacameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
cameraD.mp4
cameraD.csv
camera.txt
color.mp4
depth.mov
images.csv
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC12_S005chiffon.log
original-recipe_en
original-recipe_jp
recipe.xml
cameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
camera.txt
color.mp4
depth.mov
timestamp.csv
No Dataloadsensor.7zwater.csveye.csvelectricity.csv
2014RC13_S032No DatacameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
cameraD.mp4
cameraD.csv
camera.txt
color.mp4
depth.mov
images.csv
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC14_S031No DatacameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
cameraD.mp4
cameraD.csv
camera.txt
color.mp4
depth.mov
images.csv
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC15_S028No DatacameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
cameraD.mp4
cameraD.csv
camera.txt
color.mp4
depth.mov
images.csv
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
No Datawater.csvNo Dataelectricity.csv
2014RC16_S024chiffon.log
original-recipe_en
original-recipe_jp
recipe.xml
cameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
camera.txt
color.mp4
depth.mov
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC17_S024chiffon.log
original-recipe_en
original-recipe_jp
recipe.xml
cameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
camera.txt
color.mp4
depth.mov
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC18_S031No DatacameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
cameraD.mp4
cameraD.csv
camera.txt
color.mp4
depth.mov
images.csv
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC19_S015chiffon.log
original-recipe_en
original-recipe_jp
recipe.xml
cameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
camera.txt
color.mp4
depth.mov
timestamp.csv
thermo.7z
thermovisual.mp4
timestamp.csv
loadsensor.7zwater.csveye.csvelectricity.csv
2014RC20_S005chiffon.log
original-recipe_en
original-recipe_jp
recipe.xml
cameraA.mp4
cameraA.csv
cameraB.mp4
cameraB.csv
cameraC.mp4
cameraC.csv
camera.txt
color.mp4
depth.mov
timestamp.csv
No Dataloadsensor.7zwater.csveye.csvelectricity.csv