htcondenser documentation

htcondenser is a simple library for submitting simple jobs & DAGs on the Bristol machines.

It was designed to allow easy setting up of jobs and deployment on worker nodes, without the user worrying too much about writing custom scripts, or copying across files to HDFS.

Contents:

• htcondenser
  • What is it?
  • What do I need?
  • How do I install it?
    • 1 via pip
    • 2 by hand
  • How do I update it?
  • How do I get started?
  • Monitoring jobs/DAGs
  • A bit more detail
  • Full documentation
  • Common pitfalls
  • But I want XYZ!
  • I want to help
• Usage
  • Some basic rules/principles
  • Basic non-DAG jobs
  • Input and output file arguments
  • DAG jobs
  • Logging
• DAGstatus
  • Usage
  • Customisation
• FAQ
• Changelog
  • v0.3.0 (27th October 2016)
  • v0.2.0 (14th June 2016)
  • v0.1.0 (12th May 2016)
• htcondenser package
  • Submodules
    • htcondenser.common module
    • htcondenser.dagman module
    • htcondenser.job module
    • htcondenser.jobset module
  • Module contents

Indices and tables

• Index
• Module Index
• Search Page