Monday, November 23, 2009

Giving thanks


Most of the active Wikimedians are aware that the English language Wikipedia is largest in terms of total articles and the German Wikipedia is second, but it it comes as a surprise that the second largest featured program is not German but Turkish.

The English language Wikipedia currently has 2,111 featured pictures.  German has 747 featured pictures.  Yet the Turkish Wikipedia has 976 featured pictures.  That sets the Turkish language site in second place if one counts by Wikipedia editions.  To set this in perspective, the Turkish Wikipedia is nineteenth in overall size with 138,000 articles.  The German Wikipedia is on the verge of crossing the one million article milestone.

This means roughly 1% of the articles in the Turkish Wikipedia have featured pictures.  One featured picture can illustrate multiple articles.  That comes out as a far higher ratio than at any other Wikipedia of substantial size.

What's really interesting is how one medium sized Wikipedia developed a featured picture program that's 25% larger than the German program.  A core of perhaps half a dozen Turkish editors have been scouting other language projects' featured picture programs, translating the captions into Turkish, and adding the images to articles on their Wikipedia.  Featured picture content at the other projects is different enough from one site to another that the Turkish editors could amass three or four thousand featured pictures if they just keep doing what they're already doing.

Of course I hope they also knock on the doors of museums in their home country. Also very curious about whether this generates synergies with text edits and improvements at their Wikipedia.

Two things happen universally when people from other parts of the world see restored featured pictures about their own culture:
  1. They're delighted.
  2. They want to share information.
Now and then I do restorations about Turkish history and culture, in gratitude and to give their project an extra boost.  The most recent of these is the 1917 Ottoman heliograph crew at Huj pictured above.  Its featured candidacy is underway at the Turkish Wikipedia.  Last week the Turkish Wikipedia passed Wikimedia Commons as the project where I have the second most featured content credits.  Darned if I understand the discussion other than the succession of green light icons.

The Turkish editors have created a model that can be emulated.  And I'm very interested in trying a pilot project with another Wikipedia to see whether a caption translation and featured picture drive would provide a shot in the arm in terms of editor participation and article growth.

One place where I'm proposing a pilot program is the Irish language Wikipedia.  They already have a small featured picture program (two dozen images, a quarter of which I restored) and I know one of their administrators (hi there Alison) and have done a few restorations specific to her country and culture.  A few days ago President Kennedy came up in conversation and I asked whether she knew en:wiki has a featured picture of his brother.

There's Robert F. Kennedy at a CORE rally in 1963: the Attorney General of the United States speaking from the steps of the Justice Department in favor of racial equality.

Very cool.

Right now the Irish Wikipedia is the ninety-second largest Wikipedia with 9,274 total articles.  If their editor community is willing I'd like to help them emulate the Turkish featured picture program.

Although I can't speak a word of either language, if a picture is worth a thousand words we can hold a conversation.

Sunday, November 22, 2009

Letter perfect


Thumbnail previews and reduced size views don't always reveal how much work a restoration is going to require.  This World War I era poster is in very good condition.  At the web-optimized reduction for this blog post it hardly seems to need any restoration at all.  A closer look at the full size file, though, shows that this won't be a walk in the park.

It's a mostly good image with several tricky problems including a crease that runs vertically through the Statue of Liberty's hand and torch.  Today let's look at the ink smears.  It isn't unusual to encounter smeared lettering on historic posters.  Often the source of the problem is water damage.  In this instance it only affects the line that was printed in black ink.  Most of the caption is gray and doesn't have this problem, but the entire line of black lettering has ink smudges.

In case you're wondering, this poster translates to say, "Food will win the war - You came here seeking freedom, now you must help to preserve it - Wheat is needed for the allies - waste nothing."  It was printed in 1917.

Here's the most heavily damaged word at full resolution.  I actually perform the restoration at twice that resolution, but this is enough to convey what the work will be.  The basic idea is to trace the outline of each letter and substitute undamaged paper texture in place of the ink smears.  Two factors will make the difference between a mediocre repair and a good one:
  • Paper texture in historic images is not created equal.  Slight differences will occur in brightness, color balance, and roughness.  So the source area has to be chosen with an eye for those subtle distinctions or else the result will look patchy.
  • The letters have to look like they exist naturally within the cloned area.  This means the cloning has to mimic the aliasing that occurs in undamaged regions.

My first passes worked mostly with large areas and a tool setting of 12 to 15 pixels in diameter.  The source area for this cloning comes from an area that looks a bit rougher and more textured than most of the poster.  Our goal here is not to create something that's digitally perfect, but that fits seamlessly with the surrounding image.  The aim is to mimic good printing for 1917.

The narrowest parts between letters have to be done at a tool diameter of five or six pixels.  Unfortunately this is a situation where Photoshop has a big advantage over the current version of GIMP.  The Photoshop clone stamp tool has a sliding option that allows the user to select any percentage hardness.

Hardness affects how much a cloned area blends with surrounding data.  One hundred percent hardness looks like the cloned area was cut with scissors and pasted in.  Zero percent hardness is really soft and smudgy.  Smudgy is what we're trying to get away from, so we do want some hardness here.  But we don't want the text to seem like a ransom note or an old punk rock poster.  So what's needed is something in between.  A static setting is going to lose its subtlety as this work progresses from wide spaces to narrow gaps between letters.  I do most clone stamping at thirty-five percent hardness.  Getting down to half a dozen pixels, though, it helps to be able to drop that to twenty percent.



This is where GIMP users get caught between a rock and a hard place.  Hardness in GIMP is a simple on/off toggle.  If there's a plugin to make that more nuanced I'd love to know about it because the GIMP editors who work with me have real trouble with this sort of challenge.  They can get an acceptable result with the default program if they work hard enough, but it takes them several times as long as it takes me in Photoshop.  GIMP is open source, so if you happen to be a motivated programmer who likes to see this work spread free culture you could do something to help solve this problem.

I fixed the smudges on this row of text in about two hours.  If discussions with good GIMP editors are accurate, multiply that by a factor of three to five for them to get a result of comparable quality.

The full version of the completed restoration can be viewed here.  Below is a glimpse of it.


Saturday, November 21, 2009

Warm welcomes

 
More good news: another editor has gotten into image restoration and doing really good work.  The image above is a historic isothermal chart from 1823.  Jujutacular ran it as his first restoration about a week ago.  His first effort was impressive and it was a treat to see that he had gotten it from the New York Public Library website.  The pool of resources for source material is broadening.

The version Jujutacular ran as his first nomination is better than my early work.

That represents quite a lot of cleanup.  His effort really shows on the upper margin and far left.  I was on the fence about the nomination--didn't want to rain on his parade yet thought the restoration could go even farther.  Took a chance and offered to collaborate.  It turns out he's a really good sport, eager to learn, and a joy to work with.

He had a version saved without the histogram adjustment.  Smart fellow!  We traded off on additional dirt and smudge removal; both of us applied masks to correct the uneven brightness.  I added a perspective crop, patched in a margin at the lower right edge, and did the final tweaks with curves and color balance.  Sometimes it's magical when the final work feels like a time machine.  This was one of those occasions.

There's nothing quite like the moment of enjoying an editor's reaction for the first time when he realizes, "I did this."  So cheers to Jujutacular.  Looking forward to seeing his next project.

----
Per request, adding links to the full versions:

Friday, November 20, 2009

What is a stain?



The Tropenmuseum has provided a very special challenge.  This post is probably the first glimpse of it to become visible to the public.  Roughly speaking, it's something like the Bayeux Tapestry of Indonesia.  The museum had it professionally photographed in twenty-nine parts.  Then they discovered that none of the digital segments quite matched together: the lighting was slightly uneven from left to right and the thin tapestry fabric had shifted so that the fibers and images no longer matched neatly.  These problems affected every one of the twenty-nine segments; the museum staff thought the image couldn't be stitched.  We've had very enthusiastic responses from the museum staff now that I've pieced it into a single file.  It's a huge job: 992.4 MB.  Now it gets interesting.

There's a lot more to be said about the digital restoration on an image that's nearly a gigabyte than one blog post can encapsulate.  One part that's easy to recognize is the large brown stain that runs vertically along this segment.  Today's post takes a different approach to repair than the last post because this time the original design remains visible within the damaged area.

In terms of digital image data, this stain consists of three elements:
  • Brightness
  • Color
  • Contrast
If one thinks of a stain as too dark and deficient in blue and lacking contrast, then the way to eliminate the stain is to brighten, add blue, and restore contrast.  The concept is simple.  It's mainly a matter of creating enough masks to make the corrections in small increments.  Stains tend to be uneven so different portions require individual adjustments.  Here's an interim save as it looks on my monitor right now.

The proportions on this are reduced substantially from the original file, which was 13MB on this cropped area.  Yet it can be informative to see the work before the stain removal is complete.  No cloning has been done at all in this stain correction.

Wednesday, November 18, 2009

President of Suriname visits WMF partnered museum exhibit


Good news from The Netherlands.  President Ronald Venetiaan of Suriname has visited the Tropenmuseum exhibit about the cultural history of Suriname.  First Lady Lisbeth Venetiaan saw the exhibit last Saturday and was so impressed that she returned with her husband the next day.  The Suriname exhibit was developed in partnership with WMF Netherlands and the Open Progress Foundation.