February 2010 - gutvol-d - lists.pglaf.org

Re: Inkmesh
by Carel 26 Feb '10

26 Feb '10

I meant that it would be nice if the site had a version for smartphones. I was failed to realize for a moment that mini has many meanings. Carel Sent from my HTC on the Now Network from Sprint! ----- Reply message ----- From: "James Adcock" <jimad(a)msn.com> Date: Thu, Feb 25, 2010 3:38 PM Subject: [gutvol-d] Re: Inkmesh To: "'Project Gutenberg Volunteer Discussion'" <gutvol-d(a)lists.pglaf.org> >It would be nice if it had a mobi version. Not sure I understand this comment. If the result says “Kindle” and it’s a free version, then it is a ..mobi file, or else is a .prc file -- which in practice is the same as a ..mobi file if you change the file extension.

1 0

Re: Inkmesh
by Carel 26 Feb '10

26 Feb '10

I meant that it would be nice if the site had a version for smartphones. I was failed to realize for a moment that mini has many meanings. Carel Sent from my HTC on the Now Network from Sprint! ----- Reply message ----- From: "James Adcock" <jimad(a)msn.com> Date: Thu, Feb 25, 2010 3:38 PM Subject: [gutvol-d] Re: Inkmesh To: "'Project Gutenberg Volunteer Discussion'" <gutvol-d(a)lists.pglaf.org> >It would be nice if it had a mobi version. Not sure I understand this comment. If the result says “Kindle” and it’s a free version, then it is a ..mobi file, or else is a .prc file -- which in practice is the same as a ..mobi file if you change the file extension.

1 0

Re: Inkmesh
by James Adcock 25 Feb '10

25 Feb '10

>It would be nice if it had a mobi version. Not sure I understand this comment. If the result says “Kindle” and it’s a free version, then it is a .mobi file, or else is a .prc file -- which in practice is the same as a .mobi file if you change the file extension.

1 0

Re: Inkmesh
by Carel 25 Feb '10

25 Feb '10

Very nice resource. Thank you! It would be nice if it had a mobi version. Carel Sent from my HTC on the Now Network from Sprint! ----- Reply message ----- From: "James Adcock" <jimad(a)msn.com> Date: Thu, Feb 25, 2010 2:51 PM Subject: [gutvol-d] Inkmesh To: "'Project Gutenberg Volunteer Discussion'" <gutvol-d(a)lists.pglaf.org> Just found about this site which is a cross-site search engine for free ebooks in various formats: http://inkmesh.com _______________________________________________ gutvol-d mailing list gutvol-d(a)lists.pglaf.org http://lists.pglaf.org/mailman/listinfo/gutvol-d

1 0

Re: Inkmesh
by Carel 25 Feb '10

25 Feb '10

Very nice resource. Thank you! It would be nice if it had a mobi version. Carel Sent from my HTC on the Now Network from Sprint! ----- Reply message ----- From: "James Adcock" <jimad(a)msn.com> Date: Thu, Feb 25, 2010 2:51 PM Subject: [gutvol-d] Inkmesh To: "'Project Gutenberg Volunteer Discussion'" <gutvol-d(a)lists.pglaf.org> Just found about this site which is a cross-site search engine for free ebooks in various formats: http://inkmesh.com _______________________________________________ gutvol-d mailing list gutvol-d(a)lists.pglaf.org http://lists.pglaf.org/mailman/listinfo/gutvol-d

1 0

Re: Inkmesh
by Carel 25 Feb '10

25 Feb '10

Very nice resource. Thank you! It would be nice if it had a mobi version. Carel Sent from my HTC on the Now Network from Sprint! ----- Reply message ----- From: "James Adcock" <jimad(a)msn.com> Date: Thu, Feb 25, 2010 2:51 PM Subject: [gutvol-d] Inkmesh To: "'Project Gutenberg Volunteer Discussion'" <gutvol-d(a)lists.pglaf.org> Just found about this site which is a cross-site search engine for free ebooks in various formats: http://inkmesh.com _______________________________________________ gutvol-d mailing list gutvol-d(a)lists.pglaf.org http://lists.pglaf.org/mailman/listinfo/gutvol-d

1 0

Re: d.p.'s undeserved superior attitude about "quality"
by cmiske＠ashzfall.com 25 Feb '10

25 Feb '10

>-------- Original Message -------- >Subject: [gutvol-d] Re: d.p.'s undeserved superior attitude about >"quality" >From: Bowerbird(a)aol.com >Date: Wed, February 24, 2010 5:12 pm >To: gutvol-d(a)lists.pglaf.org, bowerbird(a)aol.com >carel said: > The fact that they even strive for quality at DP is a mark in their favor. >not really. everyone is gonna tell you they strive for quality... >(trust me, nobody's gonna say, "quality doesn't matter to us.") Actually, I think google more or less did say this when they initially scanned the books (with fingers visible and all), but they now correct bad pages, so they do want quality. :) [snip] >but it's not the notion that d.p. "strives" for quality that's irritating; >it is their blind stubbornness that they have already _attained_ it, >coupled with an unwillingness to measure the price they pay for it. Yes, that is an entirely different matter. To believe one has attained perfection is quite different than the pursuit of it.... [snip] >but when you start wasting the time and energy of _other_people_ >-- who are _volunteers_ who've donated time and energy to you -- >by putting them into a workflow that is decidedly inefficient, i mind. You don't need to talk to me about having your time wasted. I am the somewhat infamous Carel that left DP nearly a decade ago (after spending around 500 hours creating a front-end and revamping the horrific code that resided on the back-end). I also tried to get them to add markup and additional computer generated pre- and post-processing and formating at the time, but they resisted. It was nice to see them add HTML a few years later. When I left DP, I was going to create my own project that had a more logical flow and used more computer processing (so as to reduce the workload for the volunteers), but the point seemed moot due to the sheer power that DP already had in the PG community. I assumed it would be quite difficult to recruit volunteers. Every once in a while, I toss the idea around again, but it always comes back to the point that the majority of volunteers willing to proof in such a fashion are already cemented in the DP process. (Now that I think about it, I believe I still have a copy of the test site for my own proofing community on some CD some place. It might be worth a chuckle to see how outdated my efforts now look.) It is nice that DP strives for quality in the work that they do. I am not however surprised that they ultimately became backlogged. DP has managed to produce a huge number of etexts and for that their efforts should be appreciated. Their etexts also have a decent level of quality. If the volunteers at DP are blissfully unaware that their time is being wasted then they do not feel like victims of the process, but rather champions of the cause. So, efficient or not, no harm is being done and books are being produced. If the inefficiency bothers you and me (and others), it's a moot point because it is not our time that is being wasted. And, we have no power to change what is at DP. At least that is the way I look at it. The only thing that does bother me is having all those books 'stuck' in the system rather than being available to the public. But the pre-release idea takes care of that. And, thank you for explaining the process that led DP to have so many rounds and member levels. That is quite the workflow, but I now understand how it came to exist. Carel

2 1

Re: d.p.'s undeserved superior attitude about "quality"
by Bowerbird＠aol.com 25 Feb '10

25 Feb '10

carel said: > I've read your posts for many years so _you're_ the one who's been reading them! ;+) > I'm not sure the most efficient system on earth > could keep up with the scan rate. sure we can. just have 10 million people do 1 book each. piece'a'cake. > And, if you speed things up by skipping the manual proofing > and use automation completely for the first release then you > will have text little to no better than what google already has. oh, don't kid yourself. google's text is _much_ better than what they're showing to us members of the general public. > Wikimedia then takes this further by adding the ability > for humans to modify the text in a never-ending cycle. i haven't been impressed by the wiki approach, honestly... > In what manner do you suggest that this would be > differentiated from the current wiki book editing > process at wikimedia that justifies the creation of > the project for the purpose of PG? i'm not suggesting this for p.g. it could be for anybody. including google. as for how it differs, please see below. > it wouldn't be that hard to cull the data from google well, it's not that "hard", but it's not that _easy_ either... first, they've started rewrapping the lines, the dirty rats. second, and more importantly, their terms prohibit it... people on this listserve have been cut off for scraping... you can still do it, of course, but you have to be careful. > Then, someone can yeah, what you've laid out is basically the standard plan. i would bother to nitpick certain parts of it, like the x.m.l., but really, my objection is at the more fundamental level. yes, i believe every page of every book should be online, on its own webpage with unchanging u.r.l., text and scan, with an error-report form that the general public can use to detail any problems with the page, or ask questions, or even make annotations and have dialog about that page... but i also believe that the text for the vast majority of these pages should be _perfect_ at the time that text is mounted. and i've demonstrated, repeatedly, that this is fully possible. one person can take an average book to near-perfection in the space of a couple hours, if they are given a good tool... ("near-perfection" means 1-error-or-less-every-10-pages.) i just showed how you can do this, using gardner's book... so, if 9 out of 10 pages are perfect to begin with, then you simply don't need a full-on wiki format. a wiki is good when you are constantly editing something. but book digitization isn't like that. corrections will be very few and far between. meanwhile, there's no reason to put every page up for grabs. even on a first pass, straight outta o.c.r., assuming good scans and a good o.c.r. app, _half_ the pages have no errors on 'em. in 2001, the idea for distributed proofreaders was brilliant. (i was once a graduate student at u.c.l.a. in social psychology, studying cooperation/competition in the arena of the internet, so i'm probably the best person on the planet to understand just precisely how brilliant the idea was, and it was brilliant.) in 2001, scansets were rare, and o.c.r. stunk (and cost a lot), and it was hard -- very hard -- to digitize a book by yourself. moreover, the primary method of connection was slow-speed. so doling out pages one-at-a-time to people online was a relatively efficient way of doing book digitization in 2001, especially as it allowed us to _cumulate_ the _partial_effort_ of many people. simply put, it made sense to go distributed. a good number of people were willing to "proof a page a day". in 2010, the situation has been turned completely on its head. scansets are no longer rare; indeed, we are swimming in them. o.c.r. no longer stinks, nor does it cost a lot. indeed, many of those scansets now _come_ with the o.c.r. already being done, and -- after some preprocessing, which isn't difficult to do -- the high level of the accuracy of that o.c.r. is rather startling. and perhaps most importantly, broadband is now widespread; we think nothing of throwing tens of megabytes around now. so, in 2010, doling out pages one-at-a-time to people online is just a silly idea. i can download in the background now, but even if i _watch_, i can download a whole scanset in minutes. and a 300k text-file that represents a book? in just seconds. these days, with the right tools at your disposal, it's possible for a person to digitize a book all by yourself in _one_hour_. i proved this -- with a stopwatch -- and documented it fully. so here's how i see things going... when you find a scanset online of a book you want to digitize, you'll download it, along with the o.c.r. (if it comes from a site that won't give you the o.c.r., you can upload it to archive.org, and they'll o.c.r. it for you. providing you have no o.c.r. app.) you'll use a handy-dandy tool to digitize it in an hour or two, and then you'll make the results available to everyone online. or... your alternative is waiting 3 years for d.p. to get it done. and carel, since you're interested in programming such tools, we'll have plenty to talk about... > I am very interested in your text processing scripts > though and always have been. I just haven't been > processing any OCR text for a while. well, like i told gardner just the other day, i really don't _have_ any collection of scripts. i use a text-editor and start looking at the book. i see an error, and devise a global search-and-replace to deal with that type of error. when they're all fixed, i look again to find the next error. i think of this process as "listening to the book", in that the book itself will tell you what kinds of errors it has... and yeah, there are some things that you do to every book, like fix spacey quotemarks, and pull in spacey contractions. and it would be good to write macros or scripts or routines to do these. but it's fairly trivial to type them in each time. it's also the case that a lot of the time you _must_ examine the text in order to approve or disapprove the change, and -- while it is not impossible to code an interface for that -- your typical text-editor _has_ one, which you know and love. > I merely meant that we are not in a position to > have any say in what DP does with itself. > Nor in what PG does with itself. but i love telling them what they should be doing, and why. because once they decide to do it, and they _will_, because i'm never wrong about these things, i can say "i told you so". -bowerbird

1 0

Re: the d.p. opinion on "prerelease" of e-texts
by Bowerbird＠aol.com 25 Feb '10

25 Feb '10

michael said: > We complile notes into computer instructions all the time, > it's not so terribly inefficient. um, ok, if you say so. > How do you think the "posted" list > gets created in the first place? i thought it was in some sensible way. but now i'm just plain afraid to ask... *** anyway, here's how the questions should be answered: 1. programs scrape the d.p. website for info about which books have been posted into which rounds... 2. when a book is posted into a new round, its file is copied to the prerelease site, and the prerelease file posted for the previous round (if there was one) is deleted. 3. when a book is posted to p.g., the latest file on the prerelease site is replaced with a pointer to p.g. 4. all of this happens _automatically_, with no need for any human intervention at all. do you see the difference? because it's a huge difference. of course, this doesn't answer the _political_ questions al asked. but those answers are above my pay grade... -bowerbird

1 0

Re: the d.p. opinion on "prerelease" of e-texts
by cmiske＠ashzfall.com 25 Feb '10

25 Feb '10

>Al said: >Will it contain only pre-release text files, or all working files associated >with a given project (page scans, illustrations, text, HTML, etc, etc)? > >If the latter, what's to stop someone from taking those files, getting their >>own clearance, and submitting them to PG as their own work? Or is DP going >to consider that they're, in effect, abandoned projects, and up for grabs? I actually hope the files are made available for others to finish. If the backlog is deep enough at DP as to warrant the creation of the pre-release area, then it would actually relieve their burden if individuals adopted some of the projects. In any case, I sincerely doubt there would be a mass wave of people grabbing up projects. If someone does finish one of these projects, I assume an attribution to DP would be included in the header to credit the work that they have done. To me, the issues of 'ownership' and 'credit' are secondary to what I believe is the main goal of getting finished works into PG so that people can read them. Carel

1 0