DEFINING EARTH DATA BATCH PROCESSING TASKS BY MEANS OF A FLEXIBLE WORKFLOWDESCRIPTION LANGUAGE
Keywords: workflow description language, earth data, batch processing, processing workflow
Abstract. This paper aims to present some of the main features of the Workflow Description Language (WorDeL) and demonstrate their usage in defining Earth Data processing tasks. This description language is based on the flexible description of processing tasks as workflows, composed of basic processing operators. This approach allows the language to offer an intuitive way of representing processing tasks, without requiring programming expertise from its users. It also allows its users to employ and integrate existing functionality into their design, thereby reducing the design complexity and development effort of newly defined processing workflows. WorDeL supports the transparent adaptive parallelization of the processing tasks over high performance computation architectures, such as cloud-based solutions. Throughout the paper, we will exemplify this language’s use in creating flexible, reusable and easy-to-understand earth data processing descriptions, with an emphasis on satellite image processing.