CURE-OR

Challenging Unreal and Real Environments for Object Recognition

Download

In order to receive the download link, please fill out this FORM to submit your information and agree to the conditions of use. These information will be kept confidential and will not be released to anybody outside the OLIVES administration team.

coca_cola_cNums_color.gif

Description

We introduced an image dataset denoted as Challenging Unreal and Real Environments for Object Recognition (CURE-OR), whose characteristics are summarized below. In CURE-OR dataset, there are 1,000,000 images of 100 objects with varying size, color, and texture, captured with multiple devices in different setups. In contrast to existing studies, the majority of images in the CURE-OR dataset were acquired with smartphones and tested with off-the-shelf applications, because we want to benchmark the recognition performance of devices and applications that are used in our daily lives rather than testing algorithms that can only work with specific hardware or testing devices that we rarely utilize.

Dataset Characteristics

  • Object classes (number of objects/class): Toy (23), Personal (10), Office (14), Household (27), Sports/Entertainment (10), Health (16)
  • Number of images per object: 10,000
  • Controlled condition (level): Background (5), Object orientation (5), Devices (5), Challenging conditions (78)
  • Backgrounds: White 2D (1), Textured 2D (2), Real 3D (2)
  • Acquisition devices: DSLR: Nikon D80, Webcam: Logitech C920, Smartphones: iPhone 6s, HTC One, LG Leon
  • Object Orientations: Front (0o), Left side (90o), Back (180o), Right side (270o), Top

Publications

D. Temel*, J. Lee*, and G. AlRegib, “CURE-OR: Challenging unreal and real environments for object recognition,” IEEE International Conference on Machine Learning and Applications, Orlando, Florida, USA, December 2018, (*: equal contribution).

Objects

objects

Backgrounds

backgrounds

Challenging Conditions

ctypes_clevels_nolabels2.jpg

File Name:  “backgroundID_deviceID_objectOrientationID_objectID_challengeType_challengeLevel.jpg”

  • backgroundID: 1: White, 2: Texture 1 – living room, 3: Texture 2 – kitchen. 4: 3D 1 – living room, 5: 3D 2 – office
  • deviceID: 1: iPhone 6s, 2: HTC One X, 3: LG Leon, 4: Logitech C920 HD Pro Webcam, 5: Nikon D80
  • objectOrientationID: 1: Front (0 º), 2: Left side (90 º), 3: Back (180 º), 4: Right side (270 º), 5: Top
  • challengeType: 01: No challenge, 02: Resize, 03: Underexposure, 04: Overexposure, 05: Gaussian blur, 06: Contrast, 07: Dirty lens 1, 08: Dirty lens 2, 09: Salt & pepper noise, 10: Grayscale, 11: Grayscale resize
    12: Grayscale underexposure, 13: Grayscale overexposure, 14: Grayscale gaussian blur, 15: Grayscale contrast, 16: Grayscale dirty lens 1, 17: Grayscale dirty lens 2, 18: Grayscale salt & pepper noise
  • challengeLevel: A number between [0, 5], where 0 indicates no challenge, 1 the least severe and 5 the most severe challenge. Challenge type 1 (no challenge) and 10 (grayscale) has a level of 0 only. Challenge types 2 (resize) and 11 (grayscale resize) has 4 levels (1 through 4). All other challenges have levels 1 to 5.

ObjectID

  • toy: Toy car – orange (020), Toy car – red (021), Baby toy – jingle (037), Baby toy – trumpet (038), Hello Kitty doll (039), Toy – Playskool (040), Jingle stick (041), Toy car (042), Stuffed animal (062)
    Minion action figure (063), Stuffed animal – horse (076), Rubber duck (078), Toy car – Green (083), Toy car – Blue (084), Monkey (085), Plastic ball – Green (086), Plastic ball – Red  Blue (087), Lion (088), Teething toy – Stars Animals (089), Teething toy – Circles Square (090)
    Toy – Red Blue (091), Toy – Yellow Green (092), Toy (093)
  • personnel belongings: Neck pillow (009), iPhone 4S (011)
    LG Cell phone (012), iPod Shuffle (013), Sunglasses – Black (024), Sunglasses – Yellow (025), Mac charger (053), Megabus water bottle pack (064), Shoes (069), Canon camera (099)
  • office supplies: Square card reader (026), Calculator (034), Hole puncher (046), Glue stick (047), Liquid white out (048)
    Tape white out (049), Marker – Expo black (050), Marker – Sharpie blue (051), Highlighter (052), Logitech Presenter remote (059), Kensington Presenter remote (060), DYMO label maker (061)
    Calculator (066), Tape dispenser (095)
  • household: Coca cola bottle – Red (001), Coca cola bottle – Green (002), Lasko Heater (006), Rival Clothing iron (007), Flask (015)
    Candle – Yellow (016), Candle – Blue (017), Lock (022), Fish keychain (027), Multipurpose pocket knives (028), Bottle opener (030), Chewing gum (033), Tile (043), Silver coffee pot (045), Cleaner (055), Stanley Tape measure (058), Jar (065), Cutlery tray (067), Strainer (070)
    Pan (071), Cheese grater (072), Barilla Spaghetti (073), BIC Lighter (074)
    Oven mitt (075), Gold coffee pot (082), Coca cola can (097), Sweet N Low sweetner (100)
  • spots/entertainment: Baseball (005), Soccer jersey (008)
    Electric air pump (010), Adidas Shinguard (014), Gloves (018)
    Armband (019), Training marker cone (068), Deck of cards – Hoyle (079), Deck of cards – Savannah (080), Soccer ball (081)
  • health/personnel care: Medicine – Spray (003), Medicine (004), Hair brush (023), Toothbrush (029), Toothpaste – Full (031)
    Toothpaste – Empty (032), Dayquil cold medicine (035), Hand soap bottle – Empty (036), Thermometer (044), Hair roller (054)
    Floss (056), ACE Elastic bandage (057), Hudson Volumetric exerciser (077), Calcium bottle (094), Hand cream (096), Hand sanitizer (098)