Many images have just one bounding box for a class that in reality has multiple instances on that image

[lamerman]

For example this image:

It has multiple chairs, but only one of them has bounding box.

Is it how it was classified or was it done intentionally?

[rkrasin]

@samihaija Sami, can you please comment on this?

[samihaija]

Ivan, thank you for the mention!

The above is intentional, assuming the image came from the training partition. We only have one box per image per entity, for the training set. However, for the validation set, we tried to have all instances boxed.

[lamerman]

@samihaija @rkrasin thank you.

@samihaija I'm not a big expert in object detection algorithms, but my first guess would be that a neural network that is learning on this data will be penalized while training. It predicts multiple chairs, but the training data has only one and my guess would be that when it predicts YES and the training data says it NO, when in reality it's YES, the network will be penalized for such predictions.

It's much more a question than statement, as I am not sure.

What do you think, could it be a problem?

P.s. I'm trying to teach YOLO using openimages.

[lamerman]

I looked at the loss function of YOLO

And it seems like absence of bounding box for image when in reality it should be will affect the loss function on line 4. And it's interesting what was the reasoning behind making only one bounding box for openimages.

[phdung]

I am curious about this method also. @lamerman @samihaija any updates about this?

[dbrazey]

Does someone has an explanation concerning the fact that training data contains only one bounding box instead of all boxes ?

As a result, this dataset cannot be used to train object detection algorithm ?

[dashesy]

because of this, Yolo does not train well with this dataset.

[ShaneYS]

@dashesy hi, do you try any other detection algorithm ( like faster rcnn, ssd ) with openimages dataset? I try to train faster rcnn with mxnet with openimages, but I have many problems when preprocessing the dataset.

[ShaneYS]

@dashesy hi, do you try any other detection algorithm ( like faster rcnn, ssd ) with openimages dataset? I try to train faster rcnn with mxnet with openimages, but I have many problems when preprocessing the dataset.

[kevinsu628]

Further, a lot of images have missing labels. Is this problem fixable?