February 2010 - gutvol-d - lists.pglaf.org

roundlessness -- 007
by Bowerbird＠aol.com 26 Feb '10

26 Feb '10

ok now, remember how i said that preprocessing is a _simple_ thing, typically with no need for a large set of checks that need to be done? on the current chunk of text i'm analyzing from rfrank's experiment, it looks like a dozen simple checks would've found 75% of the errors, right off the bat, with no need for a word-by-word proofing round... save the time and energy and _focus_ of your proofers: preprocess. -bowerbird

1 0

Re: the d.p. opinion on "prerelease" of e-texts
by Bowerbird＠aol.com 26 Feb '10

26 Feb '10

donovan said: > I stand by my characterization of PG's pre-press scheme as > both unnecessary and a disturbing shift in attitude towards DP. i don't have a dog in this fight. but i'm glad it's all "amiable" and such. -bowerbird

1 0

Our 400th Portuguese eBook
by Michael S. Hart 26 Feb '10

26 Feb '10

We are up to #398 and I have not received any suggestions for #400. Should we reserve one? Just go with whatever comes along? Other suggestions? Thanks!!! Michael

2 1

Re: the d.p. opinion on "prerelease" of e-texts
by Bowerbird＠aol.com 26 Feb '10

26 Feb '10

david (donovan) said: > All that's required is to convince the 'right' people at DP to either > A) expend limited resources towards that end > _instead_of_ where they're needed, or, > B) stand aside and allow PG to take unreasonable advantage of > what have _so_far_ been amiable terms of relationship. emphasis added... here's an obvious ploy to push things to the ultimatum stage... behold the biggest bottleneck at distributed proofreaders: donovan. -bowerbird

2 1

Re: the d.p. opinion on "prerelease" of e-texts
by Bowerbird＠aol.com 26 Feb '10

26 Feb '10

michael said: > I just figured they would perfect themselves in growing up, how? by _magic_? > I just figured they would perfect themselves in growing up, > through the natural process of our reader sending errors. but you do nothing to encourage the process of reporting errors. and it often takes _years_ for reported errors to be corrected... (and i have _never_ seen a person credited for error-reporting.) > Now we want to pretend there ARE no errors, even to points > where our bigmouth says "perfect" in referring to this. well, my big mouth _often_ says "perfect", because that is what i am aiming at, and working toward, and _attaining_, in some measure, by using methods that find and fix errors. where is the equivalent push by project gutenberg? the whitewashers announce "corrected editions" which they _know_ (or _should_ know) are woefully lacking in accuracy, because all they did was apply the corrections readers sent, instead of aggressively using known methods to find errors. nor are the whitewashers (and p.g. more generally) the sole problem in this equation... the d.p. people _love_ to go on and on about their "quality", but they have shown _absolutely_no_ interest in going back and fixing their own early crappy books. and let's not even talk about going back and fixing the early crappy p.g. books. so the d.p. people are full of horse shit on "quality" as well. > This pretense is causing us HUGE problems and denying > book access to thousands of titles we could release as "0.x." i haven't taken a stand on this issue because, as i already said, i _want_ d.p. to choke on their backlog. as a big reminder that something is very, very much wrong in their current workflow. plus there is some merit to the argument that most of these books are already available to the public in one form or other. but i wouldn't be opposed to releasing the _semi-improved_ versions that've come out of the various rounds over at d.p. (although i think some of us are kidding ourselves greatly about exactly how much that text has been "improved", i.e., very little. the typos have been removed, yes. but i could do the same job, for the most part, with a simple spellcheck, so that's no big deal.) and i think it would be great if these in-progress works were being released so people "on the outside" could improve them, but i doubt p.g. or d.p. could build the proper infrastructure for the general public to _do_ that, so i think that's nonsense. i believe everyone has good motivations in this situation. (well, except donovan, and you better watch out for him.) unfortunately, good motivations can't prevent an implosion. > I would like to see PG & DP be a little less proprietary, > a little less about who gets how much credit and a little > more about getting the books out there ASAP and then work > them up to a never ending Xeno's progress to perfection. couldn't avoid using the "p" word yourself, could you, michael? ;+) -bowerbird

1 0

Re: opinions on pre-release
by Greg M. Johnson 26 Feb '10

26 Feb '10

> Are we more worried about who > gets credit or getting books out? I don't mind seeing "produced by" in the intro to a book, but it is a bit odd to see people getting editor and author citations in the PG database. o__O The workers at Googlebooks afaics have made completely anonymous contributions-- their names aren't in the epubs. But I think we are all at a loss for not knowing the name of that lady whose lovely hand is preserved forever in so many photocopiess in their collection.

2 1

roundlessness -- 006
by Bowerbird＠aol.com 26 Feb '10

26 Feb '10

in looking at some of the text from rfrank's "roundless" experiment, there's a chunk of a book which contained 192 lines that got changed. a closer analysis showed _80_ of those lines (over 40% of the total) were unchanged except that a spacey-quotemark had been fixed... however, since the repair of spacey-quotemarks can be _automated_, that means all of those 80 lines could have been corrected in advance. if you really want roundless to work, you have to do it correctly... -bowerbird

1 0

Re: ok, let's take a look at gardner's book, just for the exercise
by Bowerbird＠aol.com 26 Feb '10

26 Feb '10

gardner said: > Thank you BB. you're welcome. and thank you. been a pleasure interacting with you. > You missed the place where I corrected the spelling of Ste Hélène. > That's 80. or 78, depending on how you count, since i stripped it to "helene". ;+) > Here, the correct spelling "seigneur" was used several other places > in the text. It seemed reasonable to correct this as a typo. you're absolutely correct. and see how we join xeno in our approach to perfection? for all of you lurkers following along with all the drama here, i might add that gardner caught a lot of errors in the p-book, especially regarding quotemarks they'd missed. he is sharp... -bowerbird

1 0

Re: ok, let's take a look at gardner's book, just for the exercise
by Bowerbird＠aol.com 26 Feb '10

26 Feb '10

ok, you might remember that gardner invited me to take a look at a book he posted -- "the advocate"... > http://www.gutenberg.org/dirs/3/1/2/1/31212/31212-8.txt > http://www.archive.org/details/advocateanovel00heavgoog > http://www.canadiana.org/ECO/ItemRecord/48293?id=16c79d4f15394e51 > http://books.google.com/books?id=ot4OAAAAYAAJ&oe=UTF-8 *** gardner's since told me that he just expected that i'd run his text through my clean-up script and report things that it found. but, as i told him a while back, i don't really have any such general clean-up script. besides... when i _really_ want to find out if a text is accurate, i compare it against another digitization, and then resolve any differences by looking at the page-scan. i've found it's an excellent way to approach perfection. i've also documented the process quite thoroughly, but i haven't gone through that exercise lately, so i thought i'd use gardner's invitation to remedy that. it's also true that i knew it'd be a good opportunity to demonstrate the importance of retaining the original linebreaks and pagebreaks when you digitize a book, so i did it for that reason as well. *** i cleaned up the o.c.r. i got from internet archive, and then compared it against gardner's proofing. i resolved the diffs by looking at the page-scan, and ended up with my final version, which is here: > http://z-m-l.com/go/gardn/gardn.zml comparing this against the p.g. e-text, i found about 79 places where the p.g. text is incorrect. i appended the list to this post, plus it is here: > http://z-m-l.com/go/gardn/gardn-79diffs.html (there _are_ 79 differences, but somebody _might_ challenge a few of them as _my_text_ being wrong, and not the p.g. e-text. i welcome dialog on them. there are about 70 cases where there is no doubt.) the vast majority of the diffs were on punctuation. abbyy v5 read many marks on the page as commas, and often garbled the semicolon/colon distinction. it recognized most letters correctly, except for h/b. despeckling might (or might not) help performance, but upgrading to abby v7 is probably the best bet... i salute gardner's courage in seeking to _improve_ his workflow. because of his openness to criticism, he's learned that his o.c.r. app does him no favors, which is a lesson that shouldn't really hurt much... especially since he ends up with a nice little list that points to some 79 possible errors in his digitization. *** it's worth noting that my cleaned-up version of the o.c.r. from archive.org was as bad as gardner's file. in the same way that the diffs helped me to find the errors in _his_ file, the diffs helped locate the errors in _mine_ -- the beauty of the comparison method is that two flawed files can produce one that is better, to the point the merged product can be nearly-perfect. given the plethora of flawed digitizations in the world, the comparison method gives us real hope for change. the fact that it is boatloads more efficient than using the word-by-word proof method is icing on the cake. if you don't understand this is the way of the future, you're not paying sufficient attention, my friend, and i suggest you get out of the way or you'll get run over. *** now, on to my last point, about pagination/linebreaks. gardner has said he will fix the errors that were found, and resubmit the book to project gutenberg; that's fine. but now there are two versions out there in the world: the one i created with original pagination/linebreaks, and a p.g. version where the text has been rewrapped. now, a person can-- with some degree of difficulty -- verify that the two versions have the exact same text... but what i have done is to juxtapose _my_ version with the page-scans of the book, so as to highlight the fact that the text i've presented does indeed match the scan: > http://z-m-l.com/go/gardn/gardnp123.html with the p.g. version, the user must take your word that the version actually does correspond well to the p-book. given the starkness of their choice, the answer is clear... in the past, when the p.g. version was the _only_ version that was available as digital text, people were _happy_ to accept that it was a copy that was accurate enough... with a choice, however, and users now _have_ a choice, i'm not sure they'll be so willing to take it on pure faith. i _am_ sure michael will want to argue about this. fine. but i don't see anything to argue about; it's a slam dunk. *** i'll do a follow-up report (tomorrow?) discussing how you can generate other versions from the .zml master, as well as how to remove the pagination and rewrap... -bowerbird p.s. ok, here are the 79 diffs between me and p.g. use a monospaced font, so the pointer-line works: looked up and sighed, and he continued: looked up and sighed, and he continued: <-- missing paragraph break here =======================================xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx soon after their union, his wife died in giving soon, after their union, his wife died in giving ====x=========================================== to hide her shame. to hide her shame, =================x jest, all sat to listen to and applaud their host's inimitable stories, his jest, all sat to listen to and applaud, their host's inimitable stories, his ======================================x===================================== or,--leaving both revelation and the pandects,--become the or,--leaving both revelation, and the pandects,--become the ============================x============================== [Illustration: "As if at the jests of another [Illustration "As if at the jests of another <-- missing colon after illustration tag =============x=============================== of birds, the lowing of cattle, the barking of dogs, the churr of the bullfrog, of birds, the lowing of cattle, the barking, of dogs, the churr of the bullfrog, ===========================================x================================ ==== creeper half concealed its rugged exterior, and clothed in creeper half concealed; its rugged exterior, and clothed in ======================x==================================== done;--what is it that alarms you? done;--what is it that alarms you?" ==================================x swearing, into the vestibule. swearing, into the vestibule ============================x and attempted to bear her off, as of old the treacherous and attempted to tear her off, as of old the treacherous =================x====================================== and the affair that had been begun in vulgar, aimless, frolic, might and the affair that had been, begun in vulgar, aimless, frolic, might ============================x========================================= in which the gallant stranger had disappeared. in which the gallant stranger, had disappeared. =============================x================= fool, that rent the kingdom,--Rehoboam fool, that rent the kingdom,--Rehoboam. ======================================x him for a block-head, a little black-browed beetle, a him for a block head, a little black-browed beetle, a ===============x===================================== my blister, my settled, ceaseless source of irritation: the cause, the cause--of my blister, my settled, ceaseless source, of irritation: the cause, the cause--of ========================================x=================================== ===== against its cause, the gallant stranger. against its cause, the gallant stranger, =======================================x and exagerrated form. Anger and shame contended in the old law and exagerrated form. Auger and shame contended in the old law =======================x====================================== sir, come,--ah, will you resist your"--father he was about to say, but he recoiled sir, come,--ah, will you resist your--" father he was about to say, but he recoiled ====================================xxxx==================================== ======== thou shalt suffer, thou shalt bend, or thou shall suffer, thou shalt bend, or =========x============================ with the cup his own hands have fashioned? with the cup his own hands have, fashioned? ===============================x=========== at last growing calmer he exclaimed: "Down, down, ye cruel thoughts, ye at last growing calmer he exclaimed; "Down, down, ye cruel thoughts, ye ===================================x==================================== not have you murdered in your old age. not have you murdered in your old, age. =================================x===== her eyes dwelt abstractedly on the sight, then, her eves dwelt abstractedly on the sight, then, =====x========================================= "Can I have heard aright, or do "Can have heard aright, or do =====xx======================== am the seignieur am the seigneur ============x=== of the beloved in rock, not sand." of the beloved in rock, not sand.' =================================x nothing heard but you," replied nothing heard but you." replied =====================x========= "Nothing, I hope," she answered, falteringly. "Nothing. I hope," she answered, falteringly. ========x==================================== beware, beware, Amanda. beware, beware, Amanda, ======================x a gentleman, who announced himself as a "gentleman, who announced himself as ==x=================================== are giddy," remarked the seigneur gravely. are giddy." remarked the seigneur gravely. =========x================================ sir, no; we are fumigated, ventilated, scented, sir, no: we are fumigated, ventilated, scented, =======x======================================= assert, 'All flesh is glass.'" assert. 'All flesh is glass.'" ======x======================= have as little for your son," said the lawyer sarcastically. have as little for your son," said, the lawyer sarcastically. ==================================x========================== the manner of one who is going to make a confidential proposal: "Either remove the manner of one who is going to make, a confidential proposal: "Either remove ======================================x===================================== ==== parent made no answer, but secretly groaned in his dilemma, and at length excl parent made no answer, but secretly, groaned in his dilemma, and at length excl ===================================x======================================== === buy brass from you at the price of gold; I will not subsidize you to avoid your ward." buy brass from you at the price of gold; will not subsidize you to avoid your ward." =========================================x================================== ========== of life you keep a care, of life you keep a care. =======================x midst of three sons and a daughter; the former being dissipated and midst of three sons and a daughter: the former being dissipated and ==================================x================================ and not ill-disposed youth; whom his and Hot ill-disposed youth; whom his ====x=============================== their peccadilloes, and entertained other ideas of foreign travel than that their peccadilloes, and entertained, other ideas of foreign travel than that ===================================x======================================== had told her of the predilection and hopes of had told her of the predilection, and hopes of ================================x============= as of one who intends no longer to be checked, nor submit to unmerited as of one who intends no longer to lie checked, nor submit to unmerited ===================================xx================================== his breast charged with a spiteful purpose; and going straight to the lodgings of his breast charged with a spiteful purpose: and going straight to the lodgings of ==========================================x================================= ===== that night, and in the morning, having obtained leave of absence, rode that night, and in the morning, haying obtained leave of absence, rode ==================================x=================================== solitary, and filled with chequered thoughts, continued his way, solitary, and filled with checquered thoughts, continued his way, =============================x=================================== you are there unto me will still be heaven. you are there unto me will still he heaven. =================================x========= before you could have asked forgiveness," replied before you could have asked forgiveness." replied =======================================x========= boundless goodness and free grace, remits the debts and manifold boundless goodness and, free grace, remits the debts and manifold =====================x=========================================== not libel love, nor our sweet fortunes," cried not libel love, nor our sweet fortunes." cried ======================================x======= It _is_ because _it must_ be; it is unselfish; nay, unto itself It is because _it must_ be; it is unselfish; nay, unto itself ===xxxx======================================================== its riders; and prompted as it seemed by fear of a rescue, the its riders; and prompted is it seemed by fear of a rescue, the =========================x===================================== to swallow the ground, until again over all burst, to swallow the ground, until again overall burst, =======================================x========== gnome, from beneath her envelopement, gnome, from beneath her envelopment, ===============================x===== will not require to find your way back this year." will not require to find your way hack this year." ==================================x=============== gazed wistfully around to discover some glimpse of dawn. gazed wistfully around to discover, some glimpse of dawn. ==================================x====================== implore you, from this man," and with the words she sprang towards implore you, from this man," find with the words she sprang towards =============================xx==================================== "Keep quiet, gentle lady; have patience, bashful beauty; sit down, sit down; come p "Keep quiet, gentle lady; have patience, bashful, beauty; sit down, sit down; come p ================================================x=========================== ======== akin to contempt, he demanded: akin to contempt, he demanded: <-- missing paragraph break here ==============================xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx No. Besides at present you have taken a long- No, Besides at present you have taken a long- ==x========================================== and taking to their heels concealed themselves amongst the trees that covere and taking to their heels concealed, themselves amongst the trees that covere ===================================x======================================== = answered; "worse than your worst suspicions, answered "worse than your worst suspicions, ========x=================================== serve? who, except the father of yon boy, the serve? who, except the father of you boy, the ===================================x========= this, thinking it to be but the jest or boast, or, at furthest, merely the loose anno this, thinking it to be but the jest or toast, or, at furthest, merely the loose anno ========================================x=================================== ========= dubious dwelling where, some hours before, dubious dwelling where, some hours before. =========================================x have her face flayed; her hair shall be plucked up by the roots;" and she have her face flayed; her hair, shall be plucked up by the roots;" and she ==============================x=========================================== are, as you seem to be, a gentleman, do not leave me;" she exclaimed be are, as you seem to be, a gentleman. do not leave me;" she exclaimed be ===================================x=================================== calm thyself, girl," echoed the ponderous calm thyself, girl." echoed the ponderous ==================x====================== advanced, and bending over her whilst his voice fell, advanced and bending over her whilst his voice fell, ========x============================================ who shall blame the sun and moon who shall blame the sun and moon <-- missing paragraph break here ================================xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx in surprise and terror. "No, in surprise and terror. "No. ===========================x called for anything of earth, but called for any thing of earth, but ==============x=================== shall ooze out drop by drop, and each drop be a portion of your life." shall ooze out drop by drop, and each, drop be a portion of your life." =====================================x================================= missing, had been caught by the advocate's keen eye, and convinced missing, had been caught by, the advocate's keen eye, and convinced ===========================x======================================= until, detected, he stood, too nigh to retreat, too terrified to advance, an until, detected, he stood, too nigh, to retreat, too terrified to advance, an ===================================x======================================== = he cried: "Demon, degenerate dog, where hast thou been walking to and fro in the he cried: "Demon, degenerate dog, where bast thou been walking to and fro in the ========================================x=================================== ===== my son, my son," he cried in agony; "Oh, my son, my son." he cried in agony; "Oh, ==============x========================= did it, all you curious crowd. did it, all you curious crowd =============================x

2 1

Re: Inkmesh
by Carel 26 Feb '10

26 Feb '10

I meant that it would be nice if the site had a version for smartphones. I was failed to realize for a moment that mini has many meanings. Carel Sent from my HTC on the Now Network from Sprint! ----- Reply message ----- From: "James Adcock" <jimad(a)msn.com> Date: Thu, Feb 25, 2010 3:38 PM Subject: [gutvol-d] Re: Inkmesh To: "'Project Gutenberg Volunteer Discussion'" <gutvol-d(a)lists.pglaf.org> >It would be nice if it had a mobi version. Not sure I understand this comment. If the result says “Kindle” and it’s a free version, then it is a ..mobi file, or else is a .prc file -- which in practice is the same as a ..mobi file if you change the file extension.

1 0