Low Disk Space Handling

To work reliably, databases in general and SciDB in particular require a minimum amount of free disk space. Running out of disk space in the midst of a database update can result in data corruption. As a defensive measure, each SciDB instance monitors the free disk space available on the device where its data directory is mounted. If an instance detects that free space has gone below a configurable threshold, SciDB will log the problem and go into read-only mode. If this happens, the system administrator must take steps to increase the free disk space by removing arrays or array versions that are no longer needed, by migrating one or more instance data directories to larger storage devices, and/or by adjusting the low disk space threshold.

Configuring the low disk space threshold

You can configure the low disk space threshold using the low-disk-space-threshold-mb parameter in the SciDB config.ini file. The parameter value is an integer count of mebibytes (MiB). The default value is 1024, that is, one gibibyte (1 GiB). You must restart the SciDB cluster after modifying this configuration parameter to have it take effect.

Encountering low disk space

When SciDB allocates disk space for a WRITE query (that is, a store(), insert(), or similar operation), it also checks the amount of free disk space. If the free space is below the configured threshold, the WRITE query fails, and the error message names the physical device that is low on space:

Once the SCIDB_LE_LOW_DISK_SPACE error occurs, the database is in read-only mode and requires operator intervention. Subsequent WRITE queries fail with the following error:

Re-enabling database WRITE queries

The initial SCIDB_LE_LOW_DISK_SPACE error gives the physical name of the device and the physical instance id of the SciDB instance that encountered the shortfall. A system administrator or a user with the needed permissions can free up space with the remove or remove_versions operators (which are still permitted although they are technically WRITE queries). Alternatively, a system administrator can migrate the instance data directory to another, larger device. To ascertain which data directory needs to be migrated, start with the physical instance id mentioned in the SCIDB_LE_LOW_DISK_SPACE error (s0-i0 in the example above) and map it to the data directory, as described in Finding the instance directory (Mapping Instance IDs) .

Once more space has been made available, the system administrator can restore write access to the database by invoking the lock_arrays(false) operator. Normal database operation can proceed.