About

A problem in research in mathematical optimization is the lack of publicly available real-life cases for benchmarking. Available benchmarks are often generated according to specific distributions that are not representative of real cases, and focus on these test cases has caused a divide to occur between established research and practical requirements. The difference in qualitative properties of generated and real cases can give a skewed view of performance of certain algorithms. At ORTEC we have an arsenal of data at our disposal, and by sharing this data we aim to bridge the divide, and contribute to the scientific community. This platform was launched on the 24th of May, 2018 at the 15th ESICUP meeting.

The benchmarks that will be published on this platform can be divided into the following categories:

Cases are first divided into categories (Load Building, Routing, or Workforce Planning) and then into sets. Sets are groups of multiple instances that share the same constraints and objectives. Not all constraints need to be met in a given solution, and the solution ranking can be queried for solutions that meet specific subsets of constraints.

Privacy

The main purpose of this website is to make real-life cases available for usage by the scientific community. However, in line with the GDPR, measures have been taken to protect privacy sensitive data: customer data has been anonymized. The core principle of our anonymization process is to remain true to the spirit of the case with respect to complexity, structure, and size, while altering the data to be untraceable to any individual or company. From this core principle different measures have been derived for, and applied to, the different categories of problems.

Reference Guideline

If you have used one or more of our benchmark cases in your research, we would like you to refer to the cases you have used. Each set of instances has its own unique identifier, following the format: "osb-[category id]-[set id]". Where the category identifier of Load Building, Routing, and Workforce Planning instances are respectively lb, r, and wp. When referring to sets of instances, add the postfix "_[instance ids]", where [instance ids] is a comma separated list of ranges of instance identifiers. A few examples of citations are given below:

"ORTEC Scientific Benchmarks: osb-lb-efr_1-101". benchmarks.ortec.com. Retrieved on 2018-05-24. "ORTEC Scientific Benchmarks: osb-lb-hpi_1,3-5". benchmarks.ortec.com. Retrieved on 2018-05-24.

where efr is the set identifier of the Efficient Fill Rate set, and hpi is the set identifier of the Heavy Palletized Items set.