- gutvol-d - lists.pglaf.org

Re: [gutvol-d] gutvol-d Digest, Vol 115, Issue 1
by Rick Tonsing 05 Jan '20

05 Jan '20

Greg & Al, OK. I got the wrong impression from the PG FAQ. Thank you for the explanations. And for correcting the FAQ. ppgen automatically cranks out those file name appendages. I'll put in a suggestion to change it from html to htm. Thank you, Rick On Sun, Jan 5, 2020 at 12:00 PM <gutvol-d-request(a)lists.pglaf.org> wrote: > Send gutvol-d mailing list submissions to > gutvol-d(a)lists.pglaf.org > > To subscribe or unsubscribe via the World Wide Web, visit > https://lists.pglaf.org/mailman/listinfo/gutvol-d > or, via email, send a message with subject or body 'help' to > gutvol-d-request(a)lists.pglaf.org > > You can reach the person managing the list at > gutvol-d-owner(a)lists.pglaf.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of gutvol-d digest..." > Today's Topics: > > 1. File Recode Service is not functional (Rick Tonsing) > 2. UTF-8 File Names (Rick Tonsing) > 3. Re: UTF-8 File Names (Greg Newby) > 4. Re: File Recode Service is not functional (Greg Newby) > 5. Re: UTF-8 File Names (Al Haines) > > > > ---------- Forwarded message ---------- > From: Rick Tonsing <okrick(a)gmail.com> > To: gutvol-d(a)lists.pglaf.org > Cc: > Bcc: > Date: Sat, 4 Jan 2020 16:43:08 -0800 > Subject: [gutvol-d] File Recode Service is not functional > FYI > > I noticed that your File Recode Service > <https://www.gutenberg.org/catalog/world/recode> is not functional. > Specifically, there is no method for entering the Filename for testing. It > appears to be intentional. > > However, if the site is intentionally disabled then you should probably > also disable the link from "V.74. What characters can I use? > <https://www.gutenberg.org/wiki/Gutenberg:Volunteers%27_FAQ#About_the_charac…> > " > > Cheers, > > Rick > > > > ---------- Forwarded message ---------- > From: Rick Tonsing <okrick(a)gmail.com> > To: gutvol-d(a)lists.pglaf.org > Cc: > Bcc: > Date: Sat, 4 Jan 2020 23:00:28 -0800 > Subject: [gutvol-d] UTF-8 File Names > The subject of file names with xxxx-lt1.txt or xxxx-lat1.txt for Latin-1 > and the xxxx-utf8.txt for UTF-8 text files came up in a DP forum > <https://www.pgdp.net/phpBB3/viewtopic.php?p=1189531#p1189531>. > > The gist of the discussion (as I see it) is that we select the file type > on the direct upload screen. Do we even need an indicator of the file type > in the file name? If so, then do we need both? UTF8 is be the default so > xxxx.txt without the (-UTF8) should be sufficient for UTF-8 files. The > -lt1 or -lat1 could remain the backup signal that the file needs to go > through the upconvert program to UTF-8. > > Cheers, > > Rick > > > > ---------- Forwarded message ---------- > From: Greg Newby <gbnewby(a)pglaf.org> > To: Project Gutenberg Volunteer Discussion <gutvol-d(a)lists.pglaf.org> > Cc: > Bcc: > Date: Sun, 5 Jan 2020 06:55:12 -0800 > Subject: Re: [gutvol-d] UTF-8 File Names > Hi, Rick. The whitewashers get whatever you upload. No transformation or > conversion is done automatically: it's just a .zip file that they download > and process. > > Informative filenames are fine. Any text should end in .txt > - Greg > > > > On Sat, Jan 04, 2020 at 11:00:28PM -0800, Rick Tonsing wrote: > > The subject of file names with xxxx-lt1.txt or xxxx-lat1.txt for Latin-1 > > and the xxxx-utf8.txt for UTF-8 text files came up in a DP forum > > <https://www.pgdp.net/phpBB3/viewtopic.php?p=1189531#p1189531>. > > > > The gist of the discussion (as I see it) is that we select the file type > on > > the direct upload screen. Do we even need an indicator of the file type > in > > the file name? If so, then do we need both? UTF8 is be the default so > > xxxx.txt without the (-UTF8) should be sufficient for UTF-8 files. The > > -lt1 or -lat1 could remain the backup signal that the file needs to go > > through the upconvert program to UTF-8. > > > > Cheers, > > > > Rick > > > _______________________________________________ > > gutvol-d mailing list > > gutvol-d(a)lists.pglaf.org > > https://lists.pglaf.org/mailman/listinfo/gutvol-d > > Unsubscribe: https://lists.pglaf.org/mailman/options/gutvol-d > > > > > > ---------- Forwarded message ---------- > From: Greg Newby <gbnewby(a)pglaf.org> > To: Project Gutenberg Volunteer Discussion <gutvol-d(a)lists.pglaf.org> > Cc: > Bcc: > Date: Sun, 5 Jan 2020 07:07:08 -0800 > Subject: Re: [gutvol-d] File Recode Service is not functional > Hi, Rick. It looks like that was never working. It doesn't have any code > for actually uploading or processing a file. > > I've edited it to indicate it's no longer in use. > > Concerning the FAQ, etc.: This will soon be deprecated. The new site is > finally nearly ready, and can be viewed here: > https://dev.gutenberg.org > > We've tried to move/remove everything outdated. Stuff that is moved to the > "atic" area is clearly marked as no longer being accurate. > > There are just a few more things to be fixed before we open this for more > widespread testing. There are also a few things that will not move yet. > > Fixes/edits can be emailed, or use a pull request here: > https://github.com/gbnewby/gutenbergsite > - Greg > > On Sat, Jan 04, 2020 at 04:43:08PM -0800, Rick Tonsing wrote: > > FYI > > > > I noticed that your File Recode Service > > <https://www.gutenberg.org/catalog/world/recode> is not functional. > > Specifically, there is no method for entering the Filename for testing. > It > > appears to be intentional. > > > > However, if the site is intentionally disabled then you should probably > > also disable the link from "V.74. What characters can I use? > > < > https://www.gutenberg.org/wiki/Gutenberg:Volunteers%27_FAQ#About_the_charac… > > > > " > > > > Cheers, > > > > Rick > > > _______________________________________________ > > gutvol-d mailing list > > gutvol-d(a)lists.pglaf.org > > https://lists.pglaf.org/mailman/listinfo/gutvol-d > > Unsubscribe: https://lists.pglaf.org/mailman/options/gutvol-d > > > > > > ---------- Forwarded message ---------- > From: Al Haines <ajhaines(a)shaw.ca> > To: <gbnewby(a)pglaf.org>, "'Project Gutenberg Volunteer Discussion'" < > gutvol-d(a)lists.pglaf.org>, "Joseph E. Loewenstein, M.D." < > loewenstein(a)sssnet.com>, "'Al Haines'" <ajhaines(a)shaw.ca>, "'Chuck > Greif'" <cbgrf(a)yahoo.com>, "'David Widger'" <cdwidger(a)gmail.com> > Cc: > Bcc: > Date: Sun, 5 Jan 2020 11:51:53 -0800 > Subject: Re: [gutvol-d] UTF-8 File Names > UTF8 text files should have "-utf8" in their file names, e.g. > "myfile-utf8.txt". This forces PG's posting software to treat text > files as UTF8, rather than its defaulting to Latin1/ASCII. (This has > been a de facto standard for some years now.) It's not necessary to do > this for HTML files. > > If necessary, the posting software will prompt for the correct character > set, but it's an easy prompt to skip through, or give the wrong answer > to. The presence of "-utf8" in the filename obviates the need for the > prompt. Latin1/ASCII text files don't trigger the prompt at all. > > If PG's upload check reports a UTF8 text file without the "-utf8", then > I rename the file inside the zip file, before unzipping it. > > Conversely, if a text file arrives with "-lat1", "-ltn1", "-iso", > "-asc", or some such Latin1/ASCII indicator, I rename the file to remove > it, since addhd handles Latin1/ASCII files correctly. > > Also, to avoid spurious files generated by the posting software, I make > sure the base name of the zip file is the same as the base names of the > text and HTML files, e.g. myfile.zip contains myfile.txt (or > myfile-utf8.txt) and myfile.htm. > > Re HTML files: PG's extension for them is ".htm". When an uploaded zip > file contains an HTML file with the extension ".html", I rename it, as > mentioned above. If this isn't done, the posting software copies the > file to a new file with the extension ".htm", e.g. "myfile.html" is > copied to "myfile.htm", leaving a spurious ".html" file. (BTW, the > posting software never, ever, modifies the submitted files--it copies > them to new files with the required name, then works with the new > files.) > > While I'm at it, more on file names... > > As mentioned above, I rename text and HTML files, and sometimes zip > files, so that their base names are the same (except for the "-utf8" > part of text files). There's no need for text/HTML files to have some > versioning component. For example, I recently handled a zip file named > diam-pg.zip, which contained diam-b.html and diam-cc-utf8.txt. I > renamed the files to remove the "-b" and "-cc" parts, and the zip file > to remove the "-pg" part, of their respective names. > > I've also seen names like "myfile-text.txt" and "myfile-html.html", and > "myfile-8.txt" and "myfile-h.html". There's no need for such > double-indicators of a file's type. > > There have been any number of similar variations, some probably related > to the PPer's versioning system as they work through the PPing process; > some related the PPing software. > > In one of the DP posts are these fragments: > > > All of PG uploads are currently UTF-8, even if the file is Latin-1. > > No idea where this idea comes from, but it's wrong. See below. > > > Or even do away with the appending altogether. The direct upload panel > lets > > the White Washers know what encoding to expect. So they know to run > the > > program to convert the Latin-1 characters to UTF-8. > > Also wrong. The WWers don't see PG's upload screen (except for their > own projects). They also never convert Latin1 to UTF8--that's done to > posted Latin1/ASCII files by PG's behind-the-scenes software, which the > WWers have no control over. > > I think that's sufficient food for thought/discussion for now... > > > Al > > > > > > -----Original Message----- > > From: gutvol-d [mailto:gutvol-d-bounces@lists.pglaf.org] On > > Behalf Of Greg Newby > > Sent: Sunday, January 05, 2020 6:55 AM > > To: Project Gutenberg Volunteer Discussion > > Subject: Re: [gutvol-d] UTF-8 File Names > > > > > > Hi, Rick. The whitewashers get whatever you upload. No > > transformation or conversion is done automatically: it's just > > a .zip file that they download and process. > > > > Informative filenames are fine. Any text should end in .txt > > - Greg > > > > > > > > On Sat, Jan 04, 2020 at 11:00:28PM -0800, Rick Tonsing wrote: > > > The subject of file names with xxxx-lt1.txt or xxxx-lat1.txt for > > > Latin-1 and the xxxx-utf8.txt for UTF-8 text files came up in a DP > > > forum > > <https://www.pgdp.net/phpBB3/viewtopic.php?p=1189531#p1189531> > . > > > > The gist of the discussion (as I see it) is that we select the file > > type on the direct upload screen. Do we even need an indicator of the > > > file type in the file name? If so, then do we need both? UTF8 is be > > the default so xxxx.txt without the (-UTF8) should be sufficient for > > UTF-8 files. The -lt1 or -lat1 could remain the backup signal that > > the file needs to go through the upconvert program to UTF-8. > > > > Cheers, > > > > Rick > > > _______________________________________________ > > gutvol-d mailing list > > gutvol-d(a)lists.pglaf.org > > https://lists.pglaf.org/mailman/listinfo/gutvol-d > > Unsubscribe: https://lists.pglaf.org/mailman/options/gutvol-d > > _______________________________________________ > gutvol-d mailing list > gutvol-d(a)lists.pglaf.org > https://lists.pglaf.org/mailman/listinfo/gutvol-d > Unsubscribe: https://lists.pglaf.org/mailman/options/gutvol-d > > > _______________________________________________ > gutvol-d mailing list > gutvol-d(a)lists.pglaf.org > https://lists.pglaf.org/mailman/listinfo/gutvol-d >

1 0

File Recode Service is not functional
by Rick Tonsing 05 Jan '20

05 Jan '20

FYI I noticed that your File Recode Service <https://www.gutenberg.org/catalog/world/recode> is not functional. Specifically, there is no method for entering the Filename for testing. It appears to be intentional. However, if the site is intentionally disabled then you should probably also disable the link from "V.74. What characters can I use? <https://www.gutenberg.org/wiki/Gutenberg:Volunteers%27_FAQ#About_the_charac…> " Cheers, Rick

2 1

New ebookmaker for testing
by Greg Newby 26 Nov '19

26 Nov '19

I made a DP forum posting for this topic: https://www.pgdp.net/phpBB3/viewtopic.php?f=27&t=68280 Here is what I submitted: For those who test DP productions prior to final upload at https://upload.pglaf.org : With thanks to Eric Hellman, one of our programmers, there is now a new updated version of ebookmaker (previously known as epubmaker). If you notice any problems, please email me: gbnewby(a)pglaf.org or, if it is more of a feature request, submit an issue to the tracker here: https://github.com/gutenbergtools/ebookmaker The new version is here: https://ebookmaker2.pglaf.org After some testing, we will do two things: 1. Update https://ebookmaker.pglaf.org (and variations) to point to the new version. 2. Replace the production version on www.gutenberg.org to use the new version for all new uploads. Depending on whether problems are encountered, this change might occur in a week or so. Or, we might need a longer testing period. We will then gradually run the new version on the previous eBooks (i.e., #1-#60000something). For the most part, this new version of ebookmaker is indistinguishable from the old. There are a number of under-the-covers improvements, including getting it into a source code repository with better documentation for installation and dependencies. It also includes capability to make a simple book cover, when cover images are not already part of the eBook. It also handles some error conditions or input variations more effectively than the old version. - Greg

3 6

Custom covers for a book that has no original cover available?
by James Simmons 06 Oct '19

06 Oct '19

I'm transcribing a book Harivamsha which has a PDF of the pages at archive.org but no book cover. I know I don't need to provide a cover, but I'd like to have one. While there is no book cover, there is some good art in the public domain inspired by events in the book: https://commons.wikimedia.org/wiki/Category:Harivamsa I was thinking of taking one of these images and putting the title and author on it using The GIMP and making that my e-book cover image. Is there any PG policy on this? James Simmons

4 5

http://epubmaker.pglaf.org/
by Rick Tonsing 29 Apr '19

29 Apr '19

Is http://epubmaker.pglaf.org the same app the White Washers use for uploaded files? Some people at Distributed Proofreaders think the results are different between the http://epubmaker.pglaf.org/ results and the WW results published at PG. I don't believe it but thought I'd ask here before submitting an opinion to the DP forum. Specifically what they are claiming is that the oversized image (greater than 800 x 1200px or 128KB) reduction for the epub and mobi formats is different. Cheers, Rick

4 3

Re: [gutvol-d] Technically off topic but I hope you could help
by Gardner Buchanan 02 Feb '19

02 Feb '19

This FAQ has recommendations WRT page scans: http://www.gutenberg.org/wiki/Gutenberg:Scanning_FAQ#S.21._Will_PG_store_sc… >> up to 600 dpi, and should be stored as black-and-white TIFFs with CCITT-4 (aka ITU-G4 or Fax Group 4) compression On 27-Jan.-2019 13:05, Gardner Buchanan wrote: > This guidance in the FAQ is aimed at illustrations, not raw page > scans. I got the impression you were looking to include raw page > scans which would generally be ~300-600dpi and could be above 3,000 > pixels on the long axis. Is there guidance about what to do with page > scans being contributed as part of a Gutenberg project? > > On 27-Jan.-2019 12:04, Ken Arromdee wrote: >> On Sat, 26 Jan 2019, Greg Newby wrote: >>> Concerning (Ken's) your comment about Weird etc.: I don't know what >>> scanning policy you are writing about. It's perfectly acceptable to >>> include high resolution scans. >> >> http://www.gutenberg.org/wiki/Gutenberg:HTML_FAQ#8._Recommendation:_Images >> >> >> "Since most people will be viewing these images in a browser on a >> screen with a resolution below or around 1000 pixels wide, you should >> mostly make your images not much wider than 600 pixels. If you have a >> 2000- or 3000-pixel-wide image derived from an original scan, you >> need to look at resizing it." >> >> (Is epub generated from HTML? That could compound the problem since >> epub is often read on tablets which have higher resolution than PC >> screens). >> >> I see this is a wiki, so I could delete the text in question, but I >> don't know what I could replace it with since I don't know what sizes >> PG really recommends. Also, this guideline seems to reflect actual >> practice for many books on pg, and even if those books were scanned >> years ago, the images in them are now permanently small, since >> nobody's going to go through the back catalog and rescan everything >> that has images. >> >> _______________________________________________ >> gutvol-d mailing list >> gutvol-d(a)lists.pglaf.org >> http://lists.pglaf.org/mailman/listinfo/gutvol-d >> Unsubscribe: http://lists.pglaf.org/mailman/options/gutvol-d > > -- ============================================================ Gardner Buchanan <gbuchana(a)teksavvy.com> Ottawa, ON FreeBSD: Where you want to go. Today.

2 1

Technically off topic but I hope you could help
by Ken Arromdee 02 Feb '19

02 Feb '19

I hope this is not *too* off-topic, since it isn't about Gutenberg but it is hopefully a topic of interest... I want to see a book at Google Books, The Secret Tomb (https://books.google.com/books/about/The_Secret_Tomb.html?id=0NMCTgniOIsC. This book is published in 1923 as can be seen from the first pages, so it became public domain this month. Google Books has a "Report an Issue" link which includes an option "I’d like to see the entire book, and I believe the book is in the public domain". I reported it and got a form letter reply from someone who obviously didn't understand my request and claimed that according to the publisher, the book was produced in 2009 (maybe, but it was obviously just a scan of a book from 1923, with a generic cover tacked on by a "publisher"). The book doesn't seem to be available on archive.org or on Project Gutenberg. Has anyone here had experience trying to escalate a request for a public domain book from Google Books?

4 11

I love it
by Phyllis Poor 23 Jan '19

23 Jan '19

It's still available http://actual.veraeasweeney.com <http://actual.veraeasweeney.com/> Phyllis Poor

1 0

Please test gutenberg website survey
by Greg Newby 08 Dec '18

08 Dec '18

Hi, Gutenberg volunteers. As part of the redesign, we're doing a simple website assessment survey. This is not yet live, and might be changed a bit, so I am only sharing with a few internal colleagues and lists. https://goo.gl/forms/aT9z1w7sOYQpqDPI2 Thanks! Greg Dr. Gregory B. Newby Chief Executive and Director Project Gutenberg Literary Archive Foundation www.gutenberg.org A 501(c)(3) not-for-profit organization with EIN 64-6221541 gbnewby(a)pglaf.org

1 0

Web site redesign
by Greg Newby 07 Nov '18

07 Nov '18

Hi, gutvol-d subscribers. I am working with collaborators at UNC's iBiblio and elsewhere on updating many aspects of the Web presence at www.gutenberg.org (and back-end processes). I have put the blurb below in the last couple of monthly newsletters. If you have ideas, the gutvol-d list is a good place to discuss them. There is a full grant proposal I wrote that goes into detail on the different areas of emphasis, and I'll try to make that available to people who are interested. Thanks in advance for your thoughts. - Greg * Web Site Redesign Project Project Gutenberg invites design ideas and input for Project Gutenberg's Web site and eBook landing pages, such as https://www.gutenberg.org and https://www.gutenberg.org/ebooks/100 Send an email to Greg (simply by responding to this newsletter), or you can join the gutvol-d email discussion list via: https://lists.pglaf.org/mailman/listinfo/gutvol-d Dr. Gregory B. Newby Chief Executive and Director Project Gutenberg Literary Archive Foundation www.gutenberg.org A 501(c)(3) not-for-profit organization with EIN 64-6221541 gbnewby(a)pglaf.org

1 0