How to automatically generate annotations

[Yuanhong-Zheng]

In the paper, it says that 'different from E.T. Bench in which all the samples are manually labeled, more than 40% of the samples in E.T. Instruct 164K are with automatically generated annotations'. May I ask how did you generate that in general?

[yeliudev]

Hi @Yuanhong-Zheng, for these training samples, the annotations were generated by the original dataset providers (e.g., HowToCaption, HowToStep). We did not generate them by ourselves.