List of forums • View recent posts • View recent comments •
• Go to daisy.org
FilesetRenamer in command line : java, out of memory
Hello,
I have a problem with the filesetRenamer : it works with small or medium size books but I get the following message with big books :
--------START------------
[DEBUG, Pipeline Core] Loading Transformer Fileset Renamer (class int_daisy_filesetRenamer.FilesetRenamer)
[DEBUG, Pipeline Core] Transformer loaded from file:/C:/Program%20Files/PIPELINE/pipeline-20100125/transformers/
[STATE] Task Fileset renamer just started
[DEBUG, ???] Job Parameters:
- filesetRenamerInputFile:E:\DIGIBOOK\541A000\projet\ncc.html
- filesetRenamerOutputPath:E:\DIGIBOOK\541A000\projet\renamed
- filesetRenamerPattern:seq+label
- filesetRenamerExclude:CssFile, ImageFile
- filesetRenamerFilesystemSafe:true
- filesetRenamerMaxFilenameLength:15
[STATE] Transformer Fileset Renamer just started
[INFO_FINER, Fileset Renamer] Analyzing the input DAISY 2.02 DTB ...
[INFO_FINER, Fileset Renamer] Saving the result to E:\DIGIBOOK\541A000\projet\renamed...
[ERROR, Fileset Renamer] Saving the result to An error occured: Map failed. Attempting to copy unrenamed fileset to destination folder....
[ERROR, Fileset Renamer] An error occurred: Map failed. Aborting.
[ERROR, Pipeline Core] Map failed
org.daisy.pipeline.exception.JobFailedException: Map failed
at org.daisy.pipeline.core.script.Runner.execute(Runner.java:116)
at org.daisy.pipeline.core.PipelineCore.execute(PipelineCore.java:280)
at org.daisy.pipeline.ui.CommandLineUI.main(CommandLineUI.java:213)
org.daisy.pipeline.exception.TransformerRunException: Map failed
at int_daisy_filesetRenamer.FilesetRenamer.execute(FilesetRenamer.java:169)
at org.daisy.pipeline.core.transformer.Transformer.executeWrapper(Transformer.java:174)
at org.daisy.pipeline.core.transformer.TransformerHandler.run(TransformerHandler.java:124)
at org.daisy.pipeline.core.script.Runner.execute(Runner.java:98)
at org.daisy.pipeline.core.PipelineCore.execute(PipelineCore.java:280)
at org.daisy.pipeline.ui.CommandLineUI.main(CommandLineUI.java:213)
java.io.IOException: Map failed
at sun.nio.ch.FileChannelImpl.map(Unknown Source)
at sun.nio.ch.FileChannelImpl.transferFromFileChannel(Unknown Source)
at sun.nio.ch.FileChannelImpl.transferFrom(Unknown Source)
at org.daisy.util.file.FileUtils.copyFile(FileUtils.java:129)
at org.daisy.util.file.Directory.addFile(Directory.java:381)
at org.daisy.util.file.Directory.addFile(Directory.java:327)
at org.daisy.util.file.Directory.addFileset(Directory.java:503)
at org.daisy.util.file.Directory.addFileset(Directory.java:463)
at org.daisy.util.file.Directory.addFileset(Directory.java:448)
at int_daisy_filesetRenamer.FilesetRenamer.execute(FilesetRenamer.java:165)
at org.daisy.pipeline.core.transformer.Transformer.executeWrapper(Transformer.java:174)
at org.daisy.pipeline.core.transformer.TransformerHandler.run(TransformerHandler.java:124)
at org.daisy.pipeline.core.script.Runner.execute(Runner.java:98)
at org.daisy.pipeline.core.PipelineCore.execute(PipelineCore.java:280)
at org.daisy.pipeline.ui.CommandLineUI.main(CommandLineUI.java:213)
Caused by: java.lang.OutOfMemoryError: Map failed
at sun.nio.ch.FileChannelImpl.map0(Native Method)
... 15 more
----------END---------
I confirm that it work with smaller books.
I tried to fix the values of -Xms and -Xmx size to low or high values (128, 512, 1024) but the problem persist.
Can you help us ?
Regards.

Dear Roberto, This kind of
pipeline and large files