here's more info on my collaborative proofreading site...

***

to see what we're talking about, you can visit this u.r.l.:
>   http://z-m-l.com/go/sitka/editr.pl

***

we talked about 4 main topics last week:
>   navigating the pages...
>   certifying a page as clean...
>   searching the book for a string...
>   feel the power with the "command" field...

under the 4th topic -- the command field --
we discussed 3 of the commands you can issue:
>   showmap...
>   concat...
>   showcustom...

today we'll discuss a few more commands...

***


blubberbaby...

you'll remember that i also discussed how you can
implement spellcheck functionality in your workflow.

one key to this is creating a custom dictionary for
each specific book that you are digitizing, one that
contains the words unique to that particular book...

at first, you'll have a "bad-words" list, which contains
low-frequency words not found in a regular dictionary.

the other list is the "good-words" list, which contains
high-frequency words plus those in a regular dictionary.

the process of correcting the book is one of _moving_
items on the "bad-words" list to the "good-words" list,
either by certifying o.c.r. did recognize them correctly,
or by correcting the misrecognition to what it should be.
(or, in the case of an error by the publisher, correcting it.)

what is handy, for this process, is knowing which pages
have words that are contained on the "bad-words" list.

you _could_ navigate through each of the pages, to see
which ones have flagged words, which are shown in red.

but why not have the computer just tell us what they are?

voila the next command, christened "blubberbaby", to
honor alaska, for this sitka book.  enter "blubberbaby"
in the search-field and click "find", and in a little while
-- it's not yet unoptimized, so it's about 20 seconds --
you will be shown a page that includes all of the pages
that have words which are still on the "bad-words" list...

from that display-page, you can use the links there to
open a number of these pages -- each in its own tab --
and work on them to deal with all of the flagged words.

questionable words should be handled in preprocessing,
for the most part, so if the workflow is designed correctly,
you won't need to use this "blubberbaby" command often.

but it's useful to have it, so you can do the check if desired.

and if questionable words were not fixed in preprocessing,
then you'll find "blubberbaby" to be even more important.

***


pairsearch...

you'll remember when i was discussing _inconsistencies_
in the sitka book that i used the "bad-words" list to find
possible problems.  specifically, when two variants of a
word (usually a name) came up sorted next to each other,
it was easy to spot 'em and tell that they needed checking.

here are a few of them, so you can see what i mean...

>   Globokoe**************
>   Golobokoe**************
>   ...
>   Golofnin**************
>   Golovin**************
>   ...
>   Hagemeister**************
>   Hagmeister**************

it's pretty obvious that these _might_ be inconsistencies...

not all of them are.  for instance, "golofnin" and "golvin"
were -- apparently -- the names of two different people.

but the others were errors made by the original printer,
errors that coulda been caught (i caught 'em) and fixed.

what you have to do, though, to check these pairs out,
is go to the actual pages where they appear, and read
the text, so as to determine the correct course of action.

now, with the search capability, it's fairly easy to do that.

you just enter each term, and then click on the links to
open up the pages where that term appears.  fairly easy.

but that can get a bit tiresome if you have a lot to check.

so i programmed this "pairsearch" command to help out.

you enter the command "pairsearch", followed by pairs
of terms that you want to search for, and the program
presents the relevant pages to help you make a decision.

so, for instance, for the three pairs above, you'd enter:

>   pairsearch hagemeister hagmeister golofnin golovin globokoe golobokoe

the search-terms can be separated by spaces or line-ends.

the output from that search is appended to this message.
the lines are long, and will likely wrap, so it's also here:
>   http://z-m-l.com/go/sitka/pairsearch-output.html

the pagenames aren't linked now, but eventually will be.

this "pairsearch" command can be extremely useful in
resolving inconsistencies within the book, both those
introduced by o.c.r. and those by the original publisher.

one more note...

remember that publishers back in the old days didn't have
the wonderful tools that we now have at our disposal, so
it's no wonder that they had some problems when it came
to words like "globokoe" and "golobokoe", or russian names.
i'm sure if i had to use the primitive tools they had back then,
i'd be making 3 times as many errors as they made, or more...

***


end-page-hyphenates

d.p. has proofers mark end-page-hyphenates with an asterisk.
i'm not sure why they feel that's necessary.  the computer can
find end-page-hyphenates just fine.  here's a routine to do it.

put the command "end-page-hyphenates" in the search-field,
and then click "find", and you'll get a list of where they occur.
the list has links for both pages, containing both fragments...

for this book, you'll get this:

>   sitkap002.txt ... and ... sitkap003.txt
>   sitkap007.txt ... and ... sitkap008.txt
>   sitkap018.txt ... and ... sitkap019.txt
>   sitkap019.txt ... and ... sitkap020.txt
>   sitkap021.txt ... and ... sitkap022.txt
>   sitkap027.txt ... and ... sitkap028.txt
>   sitkap043.txt ... and ... sitkap044.txt
>   sitkap051.txt ... and ... sitkap052.txt
>   sitkap077.txt ... and ... sitkap078.txt
>   sitkap079.txt ... and ... sitkap080.txt
>   sitkap083.txt ... and ... sitkap084.txt
>   sitkap087.txt ... and ... sitkap088.txt
>   sitkap102.txt ... and ... sitkap103.txt

those pagenames are clickable, and take you to that page...

there isn't a lot of reason you need to check those fragments,
since the computer will also rejoin 'em if you unwrap the text.

but if i didn't include this functionality, you know _someone_
would say "yeah, but your system doesn't do _this_, does it?"

so now i can say, "well yes, as a matter of fact, it _does_..."

***

so, we've added "blubberbaby" and "pairsearch" commands,
as well as "end-page-hyphenates"; that's enough for today.

by now, you should have a pretty good feel on how we will
continue to implement functionalities as they are needed...

we'll discuss more stuff as i get it put into place...

-bowerbird

p.s.  here's the output from the "pairsearch" command above:

> .....here it is, in order of appearance in the book:
>
> globokoe ... sitkap002.txt ... the inlet at Ozerskoe Redoubt and Globokoe (Deep) Lake; the island-studded
> hagemeister ... sitkap006.txt ... ngland English Francisco Georgeson Hagemeister Jamestown Kashavaroffs Katle
> hagemeister ... sitkap009.txt ... g instructions previously given to Hagemeister, instructing him to find the
> golofnin ... sitkap032.txt ... r the command of Captain Vasili M. Golofnin, who was widely known for his a
> golofnin ... sitkap034.txt ... stant, nor one doctor's pupil.'?? Golofnin soon left Sitka to return to St
> hagmeister ... sitkap042.txt ... ills of Golden California. Captain Hagmeister came to re- lieve him, and in
> golofnin ... sitkap045.txt ... to trade with the Kolosh [45-1] Golofnin, Voyage of the Sloop "Kamchatka
> golofnin ... sitkap060.txt ... ccording to the account of Captain Golofnin, it was an establishment well b
> golovin ... sitkap072.txt ... erica, by Captain-Lieutenant P. N. Golovin, pp. 72-73. [[72]]
> globokoe ... sitkap072.txt ... other at the Ozer- skoe Redoubt on Globokoef[72-2] (Deep) Lake, ground the
> golobokoe ... sitkap072.txt ... f the present improvement. [72-2] Golobokoe Lake was sounded to a depth cf
> hagemeister ... sitkap075.txt ... nuary 11, 1818. Leonti Andreanvich Hagemeister, Jan. 11, 1818, to Oct. 24,
> globokoe ... sitkap105.txt ... mountainside. The Redoubt and the Globokoe Lake.-- Southwest from Sitka ab
> globokoe ... sitkap106.txt ... re in the rocky wall which divided Globokoe, or Deep Lake, from the sea, an
>
>
> .....and sorted, by search-term:
>
> globokoe ... sitkap002.txt ... the inlet at Ozerskoe Redoubt and Globokoe (Deep) Lake; the island-studded
> globokoe ... sitkap072.txt ... other at the Ozer- skoe Redoubt on Globokoef[72-2] (Deep) Lake, ground the
> globokoe ... sitkap105.txt ... mountainside. The Redoubt and the Globokoe Lake.-- Southwest from Sitka ab
> globokoe ... sitkap106.txt ... re in the rocky wall which divided Globokoe, or Deep Lake, from the sea, an
>
> golobokoe ... sitkap072.txt ... f the present improvement. [72-2] Golobokoe Lake was sounded to a depth cf
>
> golofnin ... sitkap032.txt ... r the command of Captain Vasili M. Golofnin, who was widely known for his a
> golofnin ... sitkap034.txt ... stant, nor one doctor's pupil.'?? Golofnin soon left Sitka to return to St
> golofnin ... sitkap045.txt ... to trade with the Kolosh [45-1] Golofnin, Voyage of the Sloop "Kamchatka
> golofnin ... sitkap060.txt ... ccording to the account of Captain Golofnin, it was an establishment well b
>
> golovin ... sitkap072.txt ... erica, by Captain-Lieutenant P. N. Golovin, pp. 72-73. [[72]]
>
> hagemeister ... sitkap006.txt ... ngland English Francisco Georgeson Hagemeister Jamestown Kashavaroffs Katle
> hagemeister ... sitkap009.txt ... g instructions previously given to Hagemeister, instructing him to find the
> hagemeister ... sitkap075.txt ... nuary 11, 1818. Leonti Andreanvich Hagemeister, Jan. 11, 1818, to Oct. 24,
>
> hagmeister ... sitkap042.txt ... ills of Golden California. Captain Hagmeister came to re- lieve him, and in
>
>
> .....and sorted again, this time in the order in which they were entered:
>
> hagemeister ... sitkap006.txt ... ngland English Francisco Georgeson Hagemeister Jamestown Kashavaroffs Katle
> hagemeister ... sitkap009.txt ... g instructions previously given to Hagemeister, instructing him to find the
> hagemeister ... sitkap075.txt ... nuary 11, 1818. Leonti Andreanvich Hagemeister, Jan. 11, 1818, to Oct. 24,
>
> hagmeister ... sitkap042.txt ... ills of Golden California. Captain Hagmeister came to re- lieve him, and in
>
>
> golofnin ... sitkap032.txt ... r the command of Captain Vasili M. Golofnin, who was widely known for his a
> golofnin ... sitkap034.txt ... stant, nor one doctor's pupil.'?? Golofnin soon left Sitka to return to St
> golofnin ... sitkap045.txt ... to trade with the Kolosh [45-1] Golofnin, Voyage of the Sloop "Kamchatka
> golofnin ... sitkap060.txt ... ccording to the account of Captain Golofnin, it was an establishment well b
>
> golovin ... sitkap072.txt ... erica, by Captain-Lieutenant P. N. Golovin, pp. 72-73. [[72]]
>
>
> globokoe ... sitkap002.txt ... the inlet at Ozerskoe Redoubt and Globokoe (Deep) Lake; the island-studded
> globokoe ... sitkap072.txt ... other at the Ozer- skoe Redoubt on Globokoef[72-2] (Deep) Lake, ground the
> globokoe ... sitkap105.txt ... mountainside. The Redoubt and the Globokoe Lake.-- Southwest from Sitka ab
> globokoe ... sitkap106.txt ... re in the rocky wall which divided Globokoe, or Deep Lake, from the sea, an
>
> golobokoe ... sitkap072.txt ... f the present improvement. [72-2] Golobokoe Lake was sounded to a depth cf
>
>
> --30--