March 2010 - gutvol-d - lists.pglaf.org

Re: i'm a busy little bee
by Bowerbird＠aol.com 19 Mar '10

19 Mar '10

juliet said: > Only as easy as pie if the OCR got the page number correct. > In my experience, page numbers are very frequently misread. i'm getting ahead of myself, but yes, you must check them first. in the sample book which i'll be talking about, 4 pagenumbers were misrecognized in 108 pages, and 1 was entirely missing. and actually, the misrecognitions were on the left-bracket that preceded the pagenumber, rather than the pagenumber per se. but yes, it is true this book had atypically accurate recognition, and that pagenumbers are not infrequently misrecognized... however, it's also true there is a _huge_ amount of redundancy in pagenumbers -- they march on in a predictable sequence -- so routines can be written (and i have written a few of them) to "fill in" the missing numbers in an astonishingly accurate way... even the unnumbered pages stick out in a fairly distinctive way, since the numbering-sequence politely "steps around" them... but why don't we hold off further dialog until i do my full post? -bowerbird

1 0

i'm a busy little bee
by Bowerbird＠aol.com 19 Mar '10

19 Mar '10

i'm a busy little bee these days... let's see... *** i'm waiting on a response from jim so i can continue to analyze his tool, and work on my support-application... *** i grabbed the "frankenstein" content from lee passey's site, and have mounted my own version of the book over here: > http://z-m-l.com/go/fpass/dofpass.pl the perl script lets you step through the pages of the book. the script shows lee's .html files as they were when grabbed. i don't wanna mess with the complications of an .html editor, so i won't be bothering to offer an edit capability on the text, at least not quite yet... i mention this because editing is one of the thorny aspects of using .html as your saved-text format. lee is using the "kupu" html-editor. too much trouble for me, and likely far too many cross-browser inconsistencies as well. but those are lee's problems to solve, not mine. good luck, lee. *** here's a little script that tells you if a word you enter is present in the dictionary that i use. i'm not sure why you'd want to know such information, but the script was developed in support of my spiffy spellchecking feature, so it's there if you _do_ have a need: > http://z-m-l.com/go/dict17577.pl *** i'm finishing up a long post on intelligent filenaming. yes, again. but there's a good angle, important enough to warrant exposition. the angle, to steal my own thunder, is that you can easily use the pagenumber information that's contained in the o.c.r. files to rename your .txt and .png files in a more-intelligent manner. if the pagenumber in file "011.txt" says that it's pagenumber 7, you'll rename "011.txt" and "011.png" to "007.txt" and "007.png". easy as pie! *** and finally, i'm still coding my online proofing system. it's grand. i love my tools... anyway, i'll probably unveil the thing next week. yeah, yeah, i know, you can hardly wait, you're so excited... ;+) -bowerbird

2 1

Re: @!@!@!@!@!@!@! Re: [SPAM] re: New Tool "pgdiff"
by Bowerbird＠aol.com 18 Mar '10

18 Mar '10

greg said: > The pglaf mailer includes a few spam filters, one > of which adds the [SPAM] string to the subject header. why? and for what purpose? which particular "filter" is it that is doing this? can it be deactivated? if not, can you tell us how to avoid setting it off? because this "filter" is doing nothing but emitting false alarms. and it's not stopping any spam, is it? -bowerbird

1 0

jim, i have some questions about pgdiff output
by Bowerbird＠aol.com 18 Mar '10

18 Mar '10

jim, here are 55 cases where your tool seems to give us more than just the 2 choices that i would expect to see... in some cases, such as the second one listed (hot springs), it's because one of the proofer's notes contained a "|" in it. you'll want to screen the input for your significant characters, i.e., any "{" or "}" or "|", and eliminate them to avoid confusion. i have some other questions as well, but let's see if the fix for this issue provides answers for those questions as well... -bowerbird > { Seattle, | > Seattle, Washington | > Washington##} [Illustration]# > Hot { Springs;[**probable printer's error. Should be ,|next: no, ; is fine] | > Springs; } each with its individual charm;# > connect the Sitka of the past, the { Novo | > Novo Ark-*angelsk | > Arkangelsk#} of the great Russian American Company# > and their fate will never be known to a { certainty.##[Footnote | > cer-taintv.##A: | > * } January { 20th.[**,?] | > 20th. 1820, | > 1820. } a letter written by the Directory at St.# > { ====sitka0-015.txt===###[Illustration: Copyright by E. W. Merrill, | > [10]####Sitka. | > ====sitka0-015.txt===###Mount | > O#Edgecumbe.] | > H####} ====sitka0-016.txt===# > He named the mountain { San | > San Jacinthus, | > Jacinthus,}# > toward the sea, Cape { del | > del Engano. | > Engano. } No one who# > 2,000 skins of the { Morski | > Morski bobrov, | > 'bo'brov, } as they# > or { Kolosh | > Kolosh Ryeku. | > Ryeku.##} On the morning of September 28th the# > { ====sitka0-030.txt===##[Illustration: Sitka in | > [24]####1805--From | > ====sitka0-030.txt===##Lisianski's | > [Blank Voyage.] | > Page]####} ====sitka0-031.txt===# > rose the town of New Archangel { (Novo | > (Novo#Arkangelsk,) | > Arkangelsk,) } and on the kekoor was built a# > valued at 450,000 { rubles.[B]##[Footnote | > rubles.f##A: | > * } The livestock taken to Sitka in 1804 consisted of "Four# > p. { 218.)]##[Footnote | > 218.)##B: | > t } Lisianski made the surveys and named the islands of the# > { yourts, | > yourts, } in which live the { kayours | > kayours } and the# > { [Footnote A: | > * } The Russian sazhen is { 7 | > I feet.] | > feet,# > { [Footnote A: | > * } These books and letters were brought by Resanof { in | > In } the# > theft in the years when there was no custodian of such { property.]###====sitka0-043.txt===###[Illustration: The Bakery and Shops of the Russians--Later the | > property.##Sitka | > [36]####Trading | > ====sitka0-043.txt===##Co.'s | > [Blank Building.] | > Page]####} ====sitka0-044.txt===# > the { dushnoi dereva | > dushnoi or | > dereva scented | > or.,@scented } wood of the# > Place of Islands { (Chasti | > (Chasti Ostrova) | > Ostrova) } is reputed# > { [Footnote | > 103.##A: | > * } Golofnin, Voyage of the Sloop "Kamchatka," in Mat. { Pt. | > Ft. } 4, p.# > { Wrangel's | > Wraiigel's } daughter--Mary." There { is | > Is } also { to | > t-> } be found: "Died,# > the church by a partition called the { Ikonastas, | > Ikonastas,#} which is ornamented with twelve { ikons, | > ikons, } or# > { repousse | > repousse } work in the true { Russian | > Eussian } style of# > { ====sitka0-066.txt=== | > [56]####[Illustration: | > ====sitka0-066.txt===###} The { Madonna.] | > Madonna.# > { ====sitka0-071.txt===###[Illustration: | > [60]####/* | > ====sitka0-071.txt===###} The Baranof Castle.# > The { U. | > IT. S[**.] | > S } Agricultural Department { building occupies | > building-occupies } the site at the# > { [Footnote A: | > * Narative[**Narrative?] | > Narative } of a Voyage Round the { World, | > World. } 1836-1842, by Captain# > Sir Edward Belcher, Vol. { 1,[**I?] | > I, } pages { 95 | > 05 } et { sen.# > { ober off | > ober offitzer | > User } who sought her hand in marriage.# > dead in one of the small drawing { rooms."[A]##[Footnote | > rooms."*##A: | > * } Frederick { Schwatka, | > Sohwatka, } the explorer, seems to have been one of# > 24th, 1896, and the time is fixed as being in the administration { of]* | > of##====sitka0-074.txt=== | > [62]####[Illustration: | > ====sitka0-074.txt===###} The Grave of the Princess { Maksoutoff.] | > Maisoutoff.# > martin from the Yukon, others { en | > en route | > route } to# > reason for their living on this distant { shore.[A]##[Footnote | > shore.*##A: | > * } Between 1821 and 1862 there were shipped by the Russian# > (Washington, Government Printing { Office).]###====sitka0-079.txt===##[Illustration: Sitka in 1860, Near the Close | > Office).##of | > [66]####the | > ====sitka0-079.txt===###Russian | > CD#Administration.] | > CO####} ====sitka0-080.txt===# > for calico and beads, blankets and { ammunition.[A] | > ammunition.*#} This market was closed by a { portcullised | > portcul-lised# > quids; fish priced according to { size[** | > size ;?] | > ? } all according to price list established# > B: | > t } Golobokoe Lake was sounded to a depth { of | > cf } 190 fathoms# > Ivan { Vasilivich | > Vasiiivich Furuhelm, | > Funihelm, } June 22, 1859, to Dec. 2, 1863.# > { ====sitka0-090.txt===###[Illustration: Sitka in 1869--During the Time of the Military | > [76]####Occupation.] | > ====sitka0-090.txt===#####} ====sitka0-091.txt===# > in the land that had so long been their { home.[C] | > home.t#} Among those who remained are the { Kashavaroffs, | > Kashavar-offs,# > { [Footnote A: | > * } The Russian soldiery were dressed { in | > In } a dark uniform, trimmed# > it down on the bayonets of the Russian { soldiery.]##[Footnote | > soldiery.##C: | > t } On December 14, { 1807, | > 1807. } the Russian ship "Czaritza," sailed for# > Russia, via London, with { 168 | > 368 } passengers. January { 1, | > I, } 1868, the# > Ex. Doc. H. R. 41st Cong. 2nd { Ses., | > Ses.. } p. 1030; Seattle { Intelligencer, | > intelligencer,# > 123; citizens by treaty, 229. { Total, | > Total,.444. 444. | > ? } Beardslee's Report, 47th# > Erussard, Ed. Doyle, George E. Pilz, Nicholas Haley, John { McKenna, | > MCKenna,#Reub | > Keub } Albertson, John Olds and { others.# > One of the traders of the town, { Caplin, said: | > Caplin,-said:#} "De Captain may go { to ---- | > to---wid wid | > his his | > tarn# > { ====sitka0-107.txt===##[**The CP failed to rotate this page correctly.][**Seems to be fixed now :-)]#[Illustration: Sitka--East on Lincoln Street--the Governor's Walk | > [92]####of | > ====sitka0-107.txt===##the | > [Blank Russians.] | > Page]####} ====sitka0-108.txt===# > { ====sitka0-110.txt===##[Illustration: Interior of Cathedral | > [94]####of | > ====sitka0-110.txt===##St. | > [Blank Michael] | > Page]####} ====sitka0-111.txt===# > { [Footnote A: | > ? } The first church in Alaska was built at { Kodiak | > Kodlak } (Paulovski) in# > towers above the bay to the height of { 3,216 | > 3,21.6#} feet. Along the river, known as the { Kolosh | > Kolosh# > is prominent the Devil's Club { (panax | > (panax horridus), | > horrid-us},# > { ====sitka0-117.txt=== | > [100]####[Illustration: | > ====sitka0-117.txt===###} Russian { Blockhouse.] | > Blockhouse.# > drew their stores of { krasnia | > Jcrasnia ruiba | > ruiba } (the red# > the trough of the watering place of { the | > the" "Jamestown," | > Jamestown,"#} came to the beach. This place may be#

1 0

i love my tools! because the proof is in the pudding!
by Bowerbird＠aol.com 18 Mar '10

18 Mar '10

guilty as charged, keith! i _do_ love my tools! all of them! most especially the ones that i coded myself, since i put a lot of blood, sweat, and tears into each one! but even the ones that other people made, i love those too! because they make my life easier for me! and i love "easier"! and it's not that stupid kind of blind love, either. no sir. because -- don't forget it! -- the proof is in the pudding! i can tell you exactly why i love each of my tools, and those reasons are good, solid reasons with sound, logical backing. i analyze my needs, and my tools, extremely closely so that i _know_ -- with _certainty_ -- just exactly what i need and why i need it, and then i make sure that my tools deliver it, whether they were programmed by someone else (which i strongly prefer, because i _did_ mention that i love "easier") or programmed by me (due to the blood, sweat, and tears). i'm happy to share my analyses of my needs, and my tools, too, because that makes all of us smarter about all of that, and i'm happy when other people share _their_ analyses too. but yes yes yes yes yes yes yes, i _do_ love my tools! i do! and it's easy as pie to know why! the proof is in the pudding! -bowerbird

1 0

@!@!@!@!@!@!@! Re: [SPAM] re: New Tool "pgdiff"
by Bowerbird＠aol.com 18 Mar '10

18 Mar '10

why are these posts coming back with "spam" in the header? -bowerbird

2 1

[SPAM] re: New Tool "pgdiff"
by Bowerbird＠aol.com 18 Mar '10

18 Mar '10

ok, jim, here's some sample files for your tool... i'm using the book "sitka" that rfrank used on his test-site. here's the original text uploaded by rfrank for his proofers: > http://z-m-l.com/go/jimad/sitka0-ocr.txt and here's the text after the proofers were done with it: > http://z-m-l.com/go/jimad/sitka1-pp.txt if you can run that through your tool and share its output, that would be great. or i'll do it, when i next encounter a windows box. :+) -bowerbird

3 3

(no subject)
by Dan Weber 18 Mar '10

18 Mar '10

To whom it may concern: www.popsci.com This site has 137 years of Popular Science magazine page scans online for free. danweber(a)mindspring.com

3 4

[SPAM] re: New Tool "pgdiff"
by Bowerbird＠aol.com 18 Mar '10

18 Mar '10

jim said: > And the correct answer is neither A nor B but rather C == _must_ well, one could easily program the tool to offer an italicized version of an all-upper choice if you know you'll be processing p.g. e-texts. indeed, a button that will italicize both choices is easy enough to code. likewise with _any_ particular editing function that might be required... for instance, i've programmed a routine that checks for a spacey-quote; if it finds a spacey-quote in one of the choices, and the two choices are otherwise identical, it auto-selects the option without the spacey-quote. *** in reviewing the pgdiff output from the sitka files, i wanted to see if you would do much preprocessing on the files. it appears to me you did not. in general, i'd _highly_ recommend preprocessing before a comparison. the number of diffs can be significantly lowered by good preprocessing, and preprocessing is typically a far more efficient way to make changes. it also helps to know about the nature of the files that you're comparing. for instance, one of the sitka files was a post-proofing file, meaning that it was littered with artifacts of the d.p. workflow... these include "notes" the proofers leave for the post-processor. it's far better to handle these "notes" in an editor during preprocessing before you start the comparison. another artifact of the d.p. workflow is asterisks on end-line (and end-page) hyphenates. i typically just delete these asterisks, as i have no use for them. some of these were present in the o.c.r. file too, so i removed them as well... after having deleted all the asterisks associated with "notes" and hyphenates, the only asterisks left in the file were those that indicated _footnotes_ in the o.c.r. file, so i did a monitored global change of them to footnote indicators. that way, these footnote indicators wouldn't present a "spurious" difference... (i could've done a global change to the characters that indicated the second and third footnotes on a page, but i didn't bother, as there weren't too many.) it also helps to know that rfrank marks "questionable" situations with an "@", so you can search for those and deal with those before doing a comparison. oh, and one other _big_ thing. the o.c.r. file had the _pagenumbers_ in it. they were enclosed in brackets, at the bottom of most pages, which is why rfrank's preprocessing program probably didn't find them to delete them... now, those pagenumbers were deleted by the proofers -- except in the 2 cases where the proofers failed to make the deletion -- so they were _not_ present in the second file. so, to avoid the spurious diffs, you could have eliminated them from the o.c.r. file easily, with a series of reg-ex changes. on the other hand, since i _like_ pagenumbers, and want to _keep_ them, i had my tool _inject_ them from the o.c.r. file back into the proofed file... either way, it's best to eliminate as many of these "spurious" diffs as you can. and i note here, jim, that you did eliminate one case of such "spurious" diffs when you reformatted the page-scan references so they would be identical. so i encourage you to take that general idea and run with it... i _will_ talk further about the diffs that were generated anyway. but i wanted to stress the importance of doing preprocessing... *** jim, i looked at hkdiff.txt briefly. i don't know what kind of sense to make of this diff at the end: > {|or|don't|you?-that's|the|idea.|Don't|you|reckon|12} i removed the whitespace so it'd fit on one line. -bowerbird

1 0

[SPAM] re: Re: New Tool "pgdiff"
by Bowerbird＠aol.com 18 Mar '10

18 Mar '10

jim said: > If you know of a portable GUI library system > that you think is really really good let me know i use realbasic. if i didn't think it was really good, i wouldn't use it. it compiles to windows, mac (even back to classic), and linux too... -bowerbird

1 0