Preservation and Digital Access (PAnDA)
Overview
Our client’s previous workflow in digital file mass ingesting was error-prone and not scalable, therefore it needed constant maintenance to run the workflow when an error occurred. In this project, we work to make the workflow more efficient by building a ‘Preservation and Digital Access’ system or we can call it PanDA.
PanDA is a web-based user interface that efficiently handles errors, gives detailed reporting, and offers fast processing of high volumes of files. Basically, PanDA is built as distributed task processing and workflow management systems.
In high-level, the workflow is to preserve and provide access to digitised content. Digital files are encoded to represent text, images, audio, video, and more. The digital files will then be preserved and made accessible so that they can be available for many generations. This action is required to ensure access and ongoing readability through migration to new storage mediums and/or file formats. Because, as both software and hardware became obsolete, so did the mechanisms that enabled us to transfer, render and view these files.
To make PanDA become more powerful, Kororo built file and data processing using a highly resilient, secure, and scalable environment that is able to handle exceptions and errors. This effort is needed to ensure the efficiency of processing times. Not only that, Kororo also developed automated unit tests to comply with data integrity and validation within various ingestion checkpoints.
Roles
Result
Now, the workflow management system works more efficient, have faster processing time, and resistant to human errors. The system is also scalable for future development.