wiki:PipelineStepRequirementsAndDesign

SSB jwst trac wiki home

Pipeline Step Framework Requirements and Design

Purpose: to record proposals, use cases, design ideas, discussion, and decisions about how the framework for JWST Calibration Pipeline Steps should work and how it should be implemented. The focus is not on calibration algorithms as such, but the features that all such steps should have, and all the ways they can be used.

MeetingNotes: Meeting notes and actions

EmailDistributionList

PreliminaryEmails

PossibleUseCases

ProposedRequirements

ProposedUserInterfaces

ProposedConfigurationScheme

PossibleErrorAndCleanupOptions

LoggingScheme

EngineeringDatabaseInterface

CalibrationReferenceDataInterface

ReferenceDataInterface

DataModel

WcsModel

Areas of focus

  • Customization of pipelines (sequences of steps) by astronomers
    • Use cases
  • Support for command line use
  • Logging and error reporting
  • Error handling
  • Support for parallelization
  • Parameter interfaces
  • Common parameters for all steps (e.g., level of logging, error handling, etc)
  • Manner of iterating steps over many datasets (implicit or explicit, or both)
  • Handling file-based input/output between steps vs in-memory input/output

Current Activities

  • Jeff, Anton and Daryl to develop use cases
Last modified 8 years ago Last modified on 03/17/11 12:41:44