Dataset files organization


Our dataset contains two major types of file; images (png or jpeg) and hdf5 dataset files. The former ones are used to store the visual sensors streams, while the latter ones contain the records for all positioning information (ground truths and sensors). Additionally, our hdf5 files also provide information about the time synchronisation between positional and visual records.

Please note that hdf5 dataset files are binary files. You will therefore need an appropriate library to open them with your favourite programming language. Hopefully, HDF5 is a standard way of storing information and most of programming languages provide such library. If you want to explore the file with a GUI rather than a script, you can use the following hdf5 file explorer.

Directories hierarchy


Each climate setup is considered as an individual dataset part. They all have their own hdf5 dataset file and are the root of a directory hierarchy which is the same for all of them. This hierarchy is illustrated in Figure 1 (see below). In this figure, i corresponds to each trajectory number and j is the image frame number (it ranges from 0 to the number of images recorded for the corresponding trajectory).

HDF5 files content


The hdf5 data structure is illustrated in Figure 2 (see below). Its root contains one group for each trajectory. Each of those sub-dataset then has the same content organization which is detailed in Figure 2.

Since visual sensors are sampled at 25Hz, GPS at 1Hz and positioning information at 100Hz, and assuming that trajectory_i as a length of N seconds, the groups in the hdf5 dataset have the following content:

Climate setup x
  ├ color_left
   ├ trajectory_i
    ├ j.jpg
  ├ color_right
   ├ trajectory_i
    ├ j.jpg
  ├ color_down
   ├ trajectory_i
    ├ j.jpg
  ├ depth
   ├ trajectory_i
    ├ j.png
  ├ normals
   ├ trajectory_i
    ├ j.png
  ├ segmentation
   ├ trajectory_i
    ├ j.png
  ├ stereo_disparity
   ├ trajectory_i
    ├ j.png
  ├ stereo_occlusion
   ├ trajectory_i
    ├ j.png
  └ sensor_records.hdf5

Figure 1: Directories hierarchy for image storage
trajectory_i
  ├ camera_data
   ├ color_left
   ├ color_right
   ├ color_down
   ├ depth
   ├ normals
   ├ segmentation
   ├ stereo_disparity
   └ stereo_occlusion
  ├ gps
   ├ GDOP
   ├ HDOP
   ├ PDOP
   ├ VDOP
   ├ no_vis_sats
   ├ position
   └ velocity
  ├ groundtruth
   ├ attitude
   ├ angular_velocity
   ├ position
   ├ velocity
   └ acceleration
  └ imu
   ├ accelerometer
   └ gyroscope
Figure 2: Data hierarchy inside of the hdf5 dataset file