Pipeline2 Blog

Fri, 2012-03-16 11:27

The 1.2 version of the Pipeline 2 project is now available for download!

Changes since the last release include:

  • various bug fixes and small enhancements to several parts of the Pipeline 2 framework, modules and command line interface.
  • slight update of the Web Service API with more stable and consistent XML payload formats.
  • scripts that produce or consume DAISY Authoring Interchange documents have been updated to support the version 1.0 of the Z39.98-2012 Book Profile.
  • EPUB 3.0 production scripts have been tested with epubcheck version 3.0b4.

More details are available in the release notes.

As usual feedback is warmly welcome, either via the users forum or the developers mailing list.

Mon, 2012-03-12 04:42

New documentation resources are now available through the project's wiki:

  • Presentations: slides used for various presentations on the Pipeline 2 project and related standards.
  • Tutorials: tutorials created for the Pipeline 2 workshop held at RNIB in February 2012. Please note that this material is provided as-is and has not been specifically crafted for people who did not attend the workshop.
  • Samples: various examples of Web API XML payloads, client code, Pipeline 2 modules, etc...

At the time of writing, most resources have been created for the Pipeline 2 workshop held at RNIB in February 2012. Pages will however be gradually enriched with new content.

Mon, 2012-02-13 19:19

The 1.1 version of the Pipeline 2 project is now available for download!

This version notably features a totally revamped command-line tool, with a syntax based on a subcommand system, and implemented as a client application to the web service API (implemented in Ruby).

The Web Service API has been polished and all the XML payload formats have been slightly refactored. Authentication has been reinforced, and sample client code is available in a small set of programming languages (C#, Ruby, PHP).

In terms of processing functionality, this release brings no major change except for a new "DTBook to EPUB 3" script based on a combination of the existing "DTBook to DAISY AI" and "DAISY AI to EPUB 3" functionality.

Make sure to read the release notes for more details.

Last but not least, a more complete user guide is now available on the Pipeline 2 wiki. It is a work in progress and will be gradually improved and enriched, but reader feedback is already welcome!

Thu, 2011-10-13 02:55

The 1.0.1 version of the Pipeline 2 project is now available for download!

It brings a couple fixes to the recently released 1.0 version:

  • fixed Windows launchers (was not working on Japanese Windows)
  • fixed a non critical issue that prevented offline usage of the command line tool

You can safely skip this release if you're not concerned by the two fixes above.

More information is also available in the detailed release notes.

Tue, 2011-10-04 01:52

The Pipeline 2 project now has a dedicated discussion forum hosted by the DAISY Consortium:
http://www.daisy.org/forums/pipeline2

Feel free to use this forum for any feedback or user support requests!

As a reminder, developers are also welcome to join our technical discussions on the daisy-pipeline-dev Google Group (accessible either as a forum or a mailing list).

Thu, 2011-10-13 02:51

The 1.0 version of the Pipeline 2 project is now available for download!

This is the first (non-beta) public release of the Pipeline 2 project and includes:

  • a cross-platform, modular runtime framework for the Pipeline 2 modules, executable as a command line tool or via a REST web API.
  • a set of processing modules providing the following conversions:
    • dtbook-to-zedai - Convert DTBook XML to ZedAI XML
    • upgrade-dtbook - DTBook utility for upgrading to DTBook 2005-3.
    • merge-dtbook - DTBook utility for merging two or more files.
    • zedai-to-epub3 - ZedAI to EPUB 3
    • daisy202-to-epub3 - DAISY 2.02 to EPUB3
  • a set of sample documents to test the provided conversions

More information is also available in the detailed release notes.

This major milestone marks the end of the first development phase, but not the end of the project, far from it! The second development phase is currently being re-chartered and will officially begin as soon as it is approved by the DAISY Board, expectedly in early November at the São Paulo board meeting. It will bring many new features and intends to deliver steady improvements the current version. Watch this space!

Finally, as a project lead I'd like to thank and congratulate the Pipeline 2 developers (Bernhard Wagner - SBS, Javier Ascensio Cubero - Dedicon then DAISY, Jostein Austvik Jacobsen - NLB, and Marisa DeMeglio - DAISY) for all their great and sustained efforts towards this milestone.

As usual comments and feedback are welcome!

Romain Deltour, for the Pipeline 2 team.

Mon, 2011-09-26 03:23

A release candidate of the DAISY Pipeline 2 project (for the 1.0 version) is now available and can be downloaded at:
http://daisy-pipeline.googlecode.com/files/pipeline2-1.0-rc.zip

This release should be almost identical to the upcoming 1.0 release, but is tagged as "Release Candidate" to give us a few days to hunt unforeseen issues that are not already logged in our tracker. The proper 1.0 release should be published at the end of the week, after the Braille21 conference in Leipzig.

Changes since the last release include:

  • Framework
    • Improved logging configuration
    • Added support for job messages
    • Added support for job result ZIP
    • Updated libs: Calabash, Saxon, Xerces
  • Web Service
    • The result ZIP is now available
    • Logs are dispatched to the jobs output directories
  • Modules
    • daisy202-to-epub3: several enhancements
    • epub3-pub-utils: support for scripted content detection
    • epub3-pub-utils: support for MathML content detection
    • epub3-pub-utils: support for remote resources detection
    • epub3-pub-utils: support for SVG content detection
    • epub3-pub-utils: support for epub:switch detection
    • epub3-pub-utils: added support for setting the cover-image
    • epub3-pub-utils: dcterms:modified is now systematically generated
    • epub3-pub-utils: dc:identifier is now added if not present (UUID scheme)
    • zedai-to-epub3: fixed bug with internal links in HTML chunks
    • zedai-to-epub3: metadata is now copied to the OPF
    • zedai-to-html: poor man's ZedAI to EPUB vocabulary translation
    • zedai-to-html: several fixes

See the release notes for a full list of changes.

An informative list of the known limitations is detailed in the README file included in the released package.

Fri, 2011-09-02 21:12

A new beta release of the DAISY Pipeline 2 project (for the 1.0 version) is now available and can be downloaded at:
http://daisy-pipeline.googlecode.com/files/pipeline2-1.0-beta3.zip

The (long) wait since the last release has been due to a major framework overhaul carried out over the past weeks. The result is the introduction of revamped APIs (XProc façade, Script, Job management) at the heart of the framework. This allows for better support for multi-threaded environments and was necessary to the development of a more robust Web API.

Changes since the last release include:

  • Framework
    • major overhaul of the core framework components
    • revamped XProc, Script and Job APIs
    • improved thread safety
    • updated the underlying XProc engine to the latest Calabash build
    • updated third-party dependencies (SLF4J+LogBack, Google Guava)
    • updated the OSGi runtime configuration
  • Web service
    • Updated the web service to the revamped APIs
    • Input files can now be sent as a ZIP
    • Improved validation of request formats
    • Sample Ruby-based client (available in the source repository)
  • Modules
    • all: updated the Script metadata
    • epub3-ocf-utils: fixed the ZIP step
    • dtbook-to-zedai: added referenced files copying
    • dtbook-to-zedai: fixed imggroup/caption issue
    • dtbook-to-zedai: minor fixes

See the release notes for a full list of changes.

An informative list of the known limitations is detailed in the README file included in the released package.

Fri, 2011-07-15 08:14

A first beta release of the DAISY Pipeline 2 project (for the 1.0 version due in September 2011) is now available and can be downloaded at:
http://daisy-pipeline.googlecode.com/files/pipeline2-1.0-beta2.zip

Changes since the last release include:

  • Framework
    • adopted Apache Felix as the underlying OSGi framework (instead of Eclipse Equinox)
    • the launcher is now the built-in Felix launcher (instead of Pax Runner)
      • reduced startup time
      • no more "Pax Runner" ASCII banner
    • adopted Apache Felix File Install to configure the installed bundles and start levels
    • updated and fixed the logging framework (based on SLF4J + Logback)
  • Web service
    • Restlet logging statements are now intercepted, using the JUL bridge for SLF4J
    • Converters are now identified with their URI, in a query parameter
    • minor fixes
  • Modules
    • daisy202-to-epub3: added an option to generate an NCX from the EPUB 3 Navigation Document
    • daisy202-to-epub3: production of Media Overlays is now optional
    • epub3-nav-utils: added an XSLT to generate an NCX from an EPUB 3 Navigation Document
    • fileset-utils: bug fixes
    • mediaoverlay-utils: added XSLTs to extract audio and text referenced from SMIL files

See the release notes for a full list of changes.

Please be aware that this is beta software with many rough edges. An informative list of the known limitations is detailed in the README file included in the released package.

Fri, 2011-07-01 19:42

A first beta release of the DAISY Pipeline 2 project (for the 1.0 version due in September 2011) is now available and can be downloaded at:

http://daisy-pipeline.googlecode.com/files/pipeline2-1.0-beta1.zip

The package includes:

  • a modular runtime framework (based on OSGi) for the Pipeline 2 modules, executable as a command line tool or via a REST web API.
  • a set of processing modules providing the following conversions:
    • dtbook-to-zedai - Convert DTBook XML to ZedAI XML
    • upgrade-dtbook - DTBook utility for upgrading to DTBook 2005-3.
    • merge-dtbook - DTBook utility for merging two or more files.
    • zedai-to-epub3 - ZedAI to EPUB 3
    • daisy202-to-epub3 - DAISY 2.02 to EPUB3
  • a set of sample documents to test the provided conversions

Please be aware that this is beta software with many rough edges. An informative list of the known limitations is detailed in the README file included in the released package.

From now on, the Pipeline 2 team will try and publish incremental releases every two weeks until the final release is made available in September 2011.

Many thanks to the Pipeline 2 developers for their hard work!

Pages

Subscribe to pipeline2 Recent Blog Posts