Using a personnal dataset¶
In addition to the datasets embedded in HyperNOMAD, the user can choose to use a personnal dataset by specifying the following informations in the parameter file:
DATASET CUSTOM
NUMBER_OF_CLASSES 20
When using a CUSTOM dataset, it is mandatory to provide HyperNOMAD with the number of classes. The user is also responsible of plugging the 3 datasets (training, validation and testing) into the blackbox. In the file blackbox.py, the lines 80 to 84 must be completed with the adequate information.
# Load the data
print('> Preparing the data..')
if dataset is not 'CUSTOM':
dataloader = DataHandler(dataset, batch_size)
image_size, number_classes = dataloader.get_info_data
trainloader, validloader, testloader = dataloader.get_loaders()
else:
# Add here the adequate information
image_size = None
number_classes = None
trainloader = None
validloader = None
testloader = None
The image size is a tuple of the form : (number_input_channels, length_image, width_image). In the case of MNIST, the image size is (1, 28, 28).
The trainload, validloader and testloader must be instances of ‘torch.utils.data.dataloader.DataLoader’.