Pipeline 2 CLI

Forums: 

Thanks Romain.

Please see below the full command line that I have tried:

dp2.bat -s dtbook-to-zedai -i source=d:/projects/ip/DTB04562.xml -t opt-output-dir=d:/projects/op/DTB04562.xml

Thanks
Sunny

The "opt-output-dir" option must be a URI, not a path. It should work with:

dp2.bat -s dtbook-to-zedai -i source=d:/projects/TPB_ePub3.0/Planman/ip/DTB04562.xml -t opt-output-dir=file:/d:/projects/TPB_ePub3.0/Planman/op/DTB04562.xml

Hope this helps,
Romain.

Hi Romain,

Still I'm getting the message as below

INFO [ org.daisy.pipeline.logging.Activator] earlyStartup slf4j SLF
andler... @org.daisy.pipeline.logging.Activator:17#start
Unrecoverable error: Unknown
ERROR [ o.d.pipeline.ui.commandline.PipelineCLI] null @o.d.p.ui.comma
pelineCLI$1:79#run
java.lang.IllegalArgumentException: null
at java.net.URI.create(Unknown Source) ~[na:1.6.0]
at java.net.URI.resolve(Unknown Source) ~[na:1.6.0]
at org.daisy.common.xproc.calabash.DynamicXProcConfigurationFac
ConfigurationFile(DynamicXProcConfigurationFactory.java:85) ~[na:na]
at org.daisy.common.xproc.calabash.DynamicXProcConfigurationFac
onfiguration(DynamicXProcConfigurationFactory.java:36) ~[na:na]
at org.daisy.common.xproc.calabash.CalabashXProcPipeline$1.get(
ProcPipeline.java:49) ~[na:na]
at org.daisy.common.xproc.calabash.CalabashXProcPipeline$1.get(
ProcPipeline.java:1) ~[na:na]
at org.daisy.common.xproc.calabash.CalabashXProcPipeline.run(Ca
ocPipeline.java:126) ~[na:na]
at org.daisy.pipeline.ui.commandline.CommandPipeline.execute(Co
line.java:89) ~[na:na]
at org.daisy.pipeline.ui.commandline.PipelineCLI$1.run(Pipeline
76) ~[na:na]
Caused by: java.net.URISyntaxException: Illegal character in opaque par
x 2: d:\daisy-pipeline\etc\conf_calabash.xml
at java.net.URI$Parser.fail(Unknown Source) ~[na:1.6.0]
at java.net.URI$Parser.checkChars(Unknown Source) ~[na:1.6.0]
at java.net.URI$Parser.parse(Unknown Source) ~[na:1.6.0]
at java.net.URI.(Unknown Source) ~[na:1.6.0]
... 9 common frames omitted

Thanks
Sunny

OK. I'll try to reproduce and will get back to you.

Thanks for the report.
Romain.

Hi Sunny,

would you let me know which version of Windows are you using?

Thanks,

Javi

Hi Javi,

I'm using Windows XP Professional Version 2002.

Thanks
Sunny

Hi Sunny,

I've just tried on a windows 7 machine and it works fine, I'm looking for a windows xp so I can check on that too. Just to be sure, are you using pipeline2-1.0.1? In the previous version we had a similar issue on Japanese windows computers.

Thanks,

Javi

Hi Javi,

Yes I'm using pipeline2-1.0.1. Please see below the log generated by this application i.e. the content of \org.daisy.pipeline.iobase_IS_UNDEFINED\default\default.log

2011-12-02 11:29:11,649 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://26.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:127:17:Message:ZedAI file name: zedai.xml
2011-12-02 11:29:11,664 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://26.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:127:17:Message step !1.23 read file:/D:/projects/ZAI/ip/DTB04562.xml
2011-12-02 11:29:11,664 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://26.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:130:17:Message:MODS file name: zedai-mods.xml
2011-12-02 11:29:11,664 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://26.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:130:17:Message step !1.24 read file:/D:/projects/ZAI/ip/DTB04562.xml
2011-12-02 11:29:11,664 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://26.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:133:17:Message:ZedAI file name: zedai-css.css
2011-12-02 11:29:11,664 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://26.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:133:17:Message step !1.25 read file:/D:/projects/ZAI/ip/DTB04562.xml
2011-12-02 11:29:11,727 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://45.0:1/dtbook-utils/upgrade-dtbook/upgrade-dtbook.xpl:51:17:Message:Input document version: 2005-3
2011-12-02 11:29:11,727 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://45.0:1/dtbook-utils/upgrade-dtbook/upgrade-dtbook.xpl:51:17:Message step !1.7 read file:/D:/projects/ZAI/ip/DTB04562.xml
2011-12-02 11:29:11,742 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://45.0:1/dtbook-utils/upgrade-dtbook/upgrade-dtbook.xpl:97:25:Message:File is already the most recent version: 2005-3
2011-12-02 11:29:11,742 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://45.0:1/dtbook-utils/upgrade-dtbook/upgrade-dtbook.xpl:97:25:Message step !1.8.4.2 read file:/D:/projects/ZAI/ip/DTB04562.xml

Hi Sunny,

I managed to get a copy of win XP, I'm still unable to reproduce your error. I'm really digging trying to solve it, I've done some research and made some changes on the pipeline where I think the problem may be. If you wish I could send you this version and see if it works on your machine ( I know this is hassle but as long as I'm not able to the same status as you I can't be 100% sure it's solved).

btw, could you also let me know which version of java are you using ?

cheers,

Hi Javi,

I posted similar issues for pipeline 2.

My tests with Debian works but not with XP and Seven using daisy202-to-epub3.

I tried the dtbook-to-zedai module with :

- java jre6
- pipeline 2 1.0.1
- Windows seven

dp2.bat -s dtbook-to-zedai -i source=C:/pipeline2_1_0_1/samples/dtbook/hauy_valid.xml -t opt-output-dir=file:/C:/pipeline2_1_0_1/samples/dtbook-to-zedai/out.xml

Log :
-------------------start---------------------------------
2011-12-08 12:26:12,651 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://19.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:127:17:Message:ZedAI file name: zedai.xml
2011-12-08 12:26:12,667 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://19.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:127:17:Message step !1.23 read file:/C:/pipeline2_1_0_1/samples/dtbook/hauy_valid.xml
2011-12-08 12:26:12,667 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://19.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:130:17:Message:MODS file name: zedai-mods.xml
2011-12-08 12:26:12,667 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://19.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:130:17:Message step !1.24 read file:/C:/pipeline2_1_0_1/samples/dtbook/hauy_valid.xml
2011-12-08 12:26:12,667 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://19.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:133:17:Message:ZedAI file name: zedai-css.css
2011-12-08 12:26:12,683 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://19.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:133:17:Message step !1.25 read file:/C:/pipeline2_1_0_1/samples/dtbook/hauy_valid.xml
2011-12-08 12:26:12,714 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://29.0:1/dtbook-utils/upgrade-dtbook/upgrade-dtbook.xpl:51:17:Message:Input document version: 2005-2
2011-12-08 12:26:12,714 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://29.0:1/dtbook-utils/upgrade-dtbook/upgrade-dtbook.xpl:51:17:Message step !1.7 read file:/C:/pipeline2_1_0_1/samples/dtbook/hauy_valid.xml
2011-12-08 12:26:17,612 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://19.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:389:45:Message:Validating ZedAI
2011-12-08 12:26:17,612 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://19.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:389:45:Message step !1.55 read file:/C:/pipeline2_1_0_1/samples/dtbook/hauy_valid.xml
2011-12-08 12:26:18,112 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://19.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:399:64:Message:Conversion complete. Storing files.
2011-12-08 12:26:18,112 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://19.0:1/dtbook-to-zedai/dtbook-to-zedai.xpl:399:64:Message step !1.57 read file:/C:/pipeline2_1_0_1/samples/dtbook/hauy_valid.xml
2011-12-08 12:26:18,190 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://19.0:1/dtbook-to-zedai/copy-referenced-files.xpl:35:21:Message:file:/C:/pipeline2_1_0_1/samples/dtbook/valentin.jpg
2011-12-08 12:26:18,190 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://19.0:1/dtbook-to-zedai/copy-referenced-files.xpl:35:21:Message step !1.8.5 read file:/C:/pipeline2_1_0_1/samples/dtbook/hauy_valid.xml
2011-12-08 12:26:18,190 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://19.0:1/dtbook-to-zedai/copy-referenced-files.xpl:39:21:Message:file:/C:/pipeline2_1_0_1/samples/dtbook-to-zedai/out.xml/valentin.jpg
2011-12-08 12:26:18,205 [INFO ] o.d.c.xproc.calabash.steps.Message - bundle://19.0:1/dtbook-to-zedai/copy-referenced-files.xpl:39:21:Message step !1.8.6 read file:/C:/pipeline2_1_0_1/samples/dtbook/hauy_valid.xml
---------------------------------end-------------------------------------

I do not understand much of this but I do not see any error but only informations.

The output folder contains 1 .*jpg, 1 zedai.xml and 1 zedai-mods.xml

Hope it can help.

Regards.

Roberto.

Roberto:

Yes, I'm getting the same output. The output needs a little cleanup, it's not currently very readable, but it's currently supposed to be there. zedai.xml is the ZedAI document, zedai-mods.xml contains metadata about the ZedAI document, and the image is an image referenced from the ZedAI document.

Sunny:

Do you get the same error with the sample DTBook included with Pipeline 2 ?

Jostein and Romain,

I'm posting my messages in two differents posts in order to inform you both.
Hope I'm not messing the forum.
You may want to close one of these topics because they are similar.

The solution given by Jostein (uri starting with 3 slashes) looks fine with W7 platform.

I told you that the test made with Debian where done copying the sample command line of the wiki page : that's not exactly true : the only difference is that my URIs starts with 3 slashes too.
I did not try with a single slash on Debian.

I will test the same solution on the xp plateform but I can't report before end of next week.

Thanks for your help.

Roberto.

Thanks for the follow-up Roberto. I do watch new forum comments so I was aware of your previous answer to Jostein already (wink).

Romain.

Hi,

Sorry for the delay.

I have converted the DTBook file included with the Pipeline 2 (i.e.hauy_valid.xml) to ZedAI. But when I tried to convert another file, which is valid against dtbook-2005-3.dtd, the process failed. The command and other error messages are attached herewith.

One thing I have noticed in the hauy_valid.xml is that the element ,... This has been captured throughout the XML file. But, I am not sure whether this caused the ZedAI conversion failure.

d:\pipeline2-1.0.1>dp2.bat -s dtbook-to-zedai -i source=d:/projects/zai/in/DTB04
562.xml -t opt-output-dir=file:///D:/projects/zai/op/,opt-zedai-filename=DTB0456
2_zai.xml
INFO [ o.d.common.xproc.calabash.steps.Message] bundle://27.0:1/dtbook-to-zedai
/dtbook-to-zedai.xpl:127:17:Message:ZedAI file name: DTB04562_zai.xml @o.d.c.x
.c.slf4jXProcMessageListener:48#info
INFO [ o.d.common.xproc.calabash.steps.Message] bundle://27.0:1/dtbook-to-zedai
/dtbook-to-zedai.xpl:127:17:Message step !1.23 read file:/d:/projects/zai/in/DTB
04562.xml @o.d.c.x.c.slf4jXProcMessageListener:75#finest
INFO [ o.d.common.xproc.calabash.steps.Message] bundle://27.0:1/dtbook-to-zedai
/dtbook-to-zedai.xpl:130:17:Message:MODS file name: zedai-mods.xml @o.d.c.x.c.
slf4jXProcMessageListener:48#info
INFO [ o.d.common.xproc.calabash.steps.Message] bundle://27.0:1/dtbook-to-zedai
/dtbook-to-zedai.xpl:130:17:Message step !1.24 read file:/d:/projects/zai/in/DTB
04562.xml @o.d.c.x.c.slf4jXProcMessageListener:75#finest
INFO [ o.d.common.xproc.calabash.steps.Message] bundle://27.0:1/dtbook-to-zedai
/dtbook-to-zedai.xpl:133:17:Message:ZedAI file name: zedai-css.css @o.d.c.x.c.
slf4jXProcMessageListener:48#info
INFO [ o.d.common.xproc.calabash.steps.Message] bundle://27.0:1/dtbook-to-zedai
/dtbook-to-zedai.xpl:133:17:Message step !1.25 read file:/d:/projects/zai/in/DTB
04562.xml @o.d.c.x.c.slf4jXProcMessageListener:75#finest
INFO [ o.d.common.xproc.calabash.steps.Message] bundle://46.0:1/dtbook-utils/up
grade-dtbook/upgrade-dtbook.xpl:51:17:Message:Input document version: 2005-3 @
o.d.c.x.c.slf4jXProcMessageListener:48#info
INFO [ o.d.common.xproc.calabash.steps.Message] bundle://46.0:1/dtbook-utils/up
grade-dtbook/upgrade-dtbook.xpl:51:17:Message step !1.7 read file:/d:/projects/z
ai/in/DTB04562.xml @o.d.c.x.c.slf4jXProcMessageListener:75#finest
INFO [ o.d.common.xproc.calabash.steps.Message] bundle://46.0:1/dtbook-utils/up
grade-dtbook/upgrade-dtbook.xpl:97:25:Message:File is already the most recent ve
rsion: 2005-3 @o.d.c.x.c.slf4jXProcMessageListener:48#info
INFO [ o.d.common.xproc.calabash.steps.Message] bundle://46.0:1/dtbook-utils/up
grade-dtbook/upgrade-dtbook.xpl:97:25:Message step !1.8.4.2 read file:/d:/projec
ts/zai/in/DTB04562.xml @o.d.c.x.c.slf4jXProcMessageListener:75#finest
Exception in thread "Thread-3" java.lang.OutOfMemoryError: Java heap space
at net.sf.saxon.tree.tiny.LargeStringBuffer.append(LargeStringBuffer.jav
a:79)
at net.sf.saxon.tree.tiny.TinyTree.appendChars(TinyTree.java:387)
at net.sf.saxon.tree.tiny.TinyBuilder.makeTextNode(TinyBuilder.java:339)

at net.sf.saxon.tree.tiny.TinyBuilder.characters(TinyBuilder.java:327)
at net.sf.saxon.event.ProxyReceiver.characters(ProxyReceiver.java:186)
at net.sf.saxon.s9api.XdmDestination$TreeProtector.characters(XdmDestina
tion.java:218)
at net.sf.saxon.event.ProxyReceiver.characters(ProxyReceiver.java:186)
at com.xmlcalabash.util.TreeWriter.addText(Unknown Source)
at com.xmlcalabash.util.TreeWriter.addSubtree(Unknown Source)
at com.xmlcalabash.util.TreeWriter.writeChildren(Unknown Source)
at com.xmlcalabash.util.TreeWriter.addSubtree(Unknown Source)
at com.xmlcalabash.library.XSLT$CatchMessages.message(Unknown Source)
at net.sf.saxon.s9api.MessageListenerProxy.write(MessageListenerProxy.ja
va:103)
at net.sf.saxon.event.SequenceWriter.append(SequenceWriter.java:306)
at net.sf.saxon.s9api.MessageListenerProxy.append(MessageListenerProxy.j
ava:87)
at net.sf.saxon.event.SequenceWriter.endDocument(SequenceWriter.java:108
)
at net.sf.saxon.event.TreeReceiver.endDocument(TreeReceiver.java:122)
at net.sf.saxon.event.ProxyReceiver.endDocument(ProxyReceiver.java:110)
at net.sf.saxon.expr.instruct.Message.processLeavingTail(Message.java:22
7)
at net.sf.saxon.expr.instruct.Block.processLeavingTail(Block.java:569)
at net.sf.saxon.expr.instruct.Template.applyLeavingTail(Template.java:20
8)
at net.sf.saxon.expr.instruct.ApplyTemplates.applyTemplates(ApplyTemplat
es.java:368)
at net.sf.saxon.expr.instruct.ApplyTemplates.apply(ApplyTemplates.java:2
32)
at net.sf.saxon.expr.instruct.ApplyTemplates.process(ApplyTemplates.java
:192)
at net.sf.saxon.expr.instruct.ElementCreator.processLeavingTail(ElementC
reator.java:318)
at net.sf.saxon.expr.instruct.Copy.processLeavingTail(Copy.java:366)
at net.sf.saxon.expr.instruct.Choose.processLeavingTail(Choose.java:758)

at net.sf.saxon.expr.instruct.Instruction.process(Instruction.java:123)
at net.sf.saxon.expr.instruct.ForEach.processLeavingTail(ForEach.java:38
7)
at net.sf.saxon.expr.instruct.Choose.processLeavingTail(Choose.java:758)

at net.sf.saxon.expr.instruct.Instruction.process(Instruction.java:123)
at net.sf.saxon.expr.instruct.ForEachGroup.processLeavingTail(ForEachGro
up.java:567)