Greenstone 2.84 released!

ak19. Friday, April 1st, 2011

After last week’s bug discovery got fixed at the start of this week (there were issues with HTML files that had non-English filenames interlinking on a Mac OS), we went back to testing the Greenstone binaries on Windows, Linux and Mac. Finally, after uploading all the files onto SourceForge and adjusting the pages there as well as updating Greenstone.org’s own download page, we succeeded in releasing Greenstone 2.84 today!

To grab the Greenstone 2.84 binary for your operating system, visit the download page at Greenstone.org. This page also has the source distributions available in zip and tar.gz formats. Otherwise, you can always expand your binary installation with source code by grabbing the “source-component” archive files from the same download page.

The Greenstone 2.84 Release Notes contain installation instructions as well as details on how to use the latest Greenstone extensions like the PDFBox extension (for later versions of PDF) and OpenOfficeConverter (which can handle the latest Office docx format).

Anu’s entry for the week ending 25 March 2011

ak19. Monday, March 28th, 2011

This week we tried to get Greenstone 3 to work on on Dr John Brine’s 64-bit Mac OS 10.6.6 machine (with Update 3) so that the Flax developers could make sure that Flax, which works with Greenstone 3, would run as well.

We didn’t have admin access on Professor Witten’s machine of similar specs, and therefore could not install the Java Developer Package which would contain the jni.h and other header files that had been relocated since Mac 10.6 Update 3 and whose absence prevented proper compilation on such Macs. However, on Dr John Brine’s machine, having admin privileges meant we could install this and get Greenstone 3 to compile on a Snow Leopard Update 3 at last. Running was  a separate issue: there were problems with the server. Sam discovered that the Java Developer Package (which contained JDK 1.6.0) would be 64 bit as well and found a flag to force Java to run in a 32 bit mode: -d32. Upon using that flag to launch the Apache web server, things ran smoothly on the server side of things. There are still issues with GLI opening collections and re-building collections in Greenstone which we will be returning to later.

Some configure and makefiles were updated to allow Greenstone to compile without compiling up wvware (since this had libiconv problems on the Mac 10.6.6, and compiling up gnome-lib on the machine has issues of its own). The –disable-wvware will allow us to temporarily bypass that and focus on other problems first.

In between, another staff member had moved his 3-year old Greenstone 3 installation elsewhere and his Greenstone web-service related application had stopped working. We got a new version of Greenstone 3 and made some configuration changes to get it all to work again.

Then it was back to testing Greenstone 2.84 to ensure that the important fixes Sam and Dr Bainbridge had made in the last weeks interacted well. I’m onto Mac testing at the moment. By Friday, we discovered that while documents with non-English unicode filenames were mostly working on the Mac, HTML files that interlinked (where the links referred to non-English filenames either directly or in URL-encoded format) did not. We started investigating this.

Sam’s Greenstone Blog 24/3/2011

admin. Thursday, March 24th, 2011

Hello Greenstone users, welcome to week 4 of my weekly blog about Greenstone development. This week I have spent most of my time working with the developers of FLAX to create an installer that will work on the most recent versions of the MacOS operating system. Those of you that use FLAX may know that it is built upon Greenstone 3 and, up until this week, the developers of the FLAX have used a modified version of the system that is used to create our Greenstone binary installers (which we internally call the release kits). I have been working with them to merge their modifications into the main release kit code so that they no longer need to keep a modified version and can simply have the release-kits enable FLAX compilation with a single switch. As part of this, several extra features were added to the Greenstone 3 compilation script, such as the ability to disable GLI and GEMS, and disabling JNI now correctly excludes the files that use it from the compilation process.

We now know enough about the Mac issues I discussed in my previous blog entry to create a version of FLAX that will (hopefully) work correctly on both the older versions and the new versions of the MacOS operating system. This is still an unsolved issue for Greenstone 3, but this is a low priority for us at the moment as the majority of our focus is on releasing Greenstone 2.84, which is currently in its final stage of testing.

See you all next week!

Sam’s Greenstone Blog 21/3/2011

admin. Monday, March 21st, 2011

I don’t really have a lot to report from last week as I was away sick for some of it. We have been investigating problems with Greenstone 3 on the most recent versions of Mac OS. As some of you may know, Greenstone 3 is programmed heavily in Java which is ideal for cross platform development. Unfortunately for us, Apple recently decided to deprecate Java on their operating system and – to cut a long story short – it makes things much more messy for us. There is also an issue on some Macs (presumably ones with later versions of the compiler we use), where they attempt to compile Greenstone as if it is 64-bit. Although we are currently working on a pure 64-bit version of Greenstone it is currently not at the stage where it is ready to be included into the main part of the code. Unfortunately we only have limited access to computers with the latest Mac OS, so finding a solution to this problem may have to wait till we can get more permanent access to a machine like this.

Anyway, see you next week!

Sam’s Greenstone Blog 11/3/2011

admin. Friday, March 11th, 2011

Welcome to week two of my new weekly blog about developing Greenstone.

This week has been quite successful as I have managed to achieve all of the things I set out to do in the previous blog and more. The ‘Oran’ skin is nearing completion now, we just need to get some real users in so we can evaluate both its functionality and its appearance.

As well as there being the small Javascript error in the Berry Basket code that I mentioned last time, there was also a bigger issue that was preventing us from displaying the quick search box on one of the Berry Basket pages. As some of you may know, Greenstone 3 uses technologies such as XML and XSLT to generate the web pages of the Greenstone Reader’s Interface. Greenstone 3 itself is made up of various Actions (that produce the XML for various types of pages) and Services (used by the Actions to do the hard work like retrieving document content or perform a query on a collection), one of which being the Berry Basket service. The quick search box requires information about TextQuery service in the collection that the user is currently within in order to generate a search box that will search that specific collection. The way one of the Berry Basket pages is created however does not make it easy for this collection information to be accessed. It uses a General action who’s ‘c’ parameter stands for Cluster instead of the more-standard Collection, so simply giving the action the current collection in the ‘c’ parameter was not sufficient as it would be for most other pages. We eventually decided that the tidiest fix was to save the collection in the ‘p.c’ parameter and to modify the Receptionist (the part of the code that produces the necessary extra information about that collection) to first look for the current collection in the ‘c’ parameter and if that did not exist then use the ‘p.c’ parameter.

If you’re still here then well done! My average day as a programmer consists of solving lots of these little problems. It may not sound very interesting to the average person but there is definitely a good sense of satisfaction when you find a way to solve these complex problems.

This week I also added a handy little feature that will prompt a user if they make a change in the preferences page and try to leave the page without hitting the “Set preferences” button. It asks them if they want to save their preferences, and if do it will go ahead and save it for them and take them to their new page. Doing this in a way that worked happily on all of the major browsers (Internet Explorer, Mozilla Firefox, Google Chrome and Apple Safari) was actually quite tricky. One way that I implemented worked happily on IE and Firefox but refused to work on Chrome/Safari. This ended up requiring a whole different approach, (involving a synchronous AJAX call in the “beforeunload” Javascript event for those who have some Javascript experience).

Anyway, that’s enough for this week. See you next week!

Sam’s Greenstone Blog 7/3/2011

admin. Monday, March 7th, 2011

Ok, so one of the things us Greenstone developers are going to try to do from now on is blog each week about what we’ve achieved that week. Ideally we’ll try to do it on Fridays, before we leave for the weekend (so this entry is a few days late).

This week I have been working hard on the development of the new default skin for Greenstone 3 – codenamed the ‘Oran’ skin. For those of you who don’t know, Oran worked here before me and I effectively took his place when he moved on to a new job. One of the things that he had been working on was this new and fresh-looking skin for Greenstone 3, and this week I have been working hard to get it ready for the Greenstone 3.05 release which will happen later in the year.

One new feature that is worth mentioning is the addition of a quick search area that is permanently in the header of the page (assuming the collection has basic query capabilities). So regardless if you’re browsing or reading a document, a basic search field is always available.

I have also been working on fixing the Berry Basket feature that was added into Greenstone 3 a while ago but had stopped working due to other changes that had been made. Having fixed the main problem (a small javascript issue) I then discovered that it did not work correctly in Internet Explorer. So this week I will be focusing on that and other Greenstone 3 user interface related issues.

Release Candidate 2 of Greenstone 2.84 out

ak19. Friday, February 25th, 2011

After a lot more testing, discovering bugs, fixing bugs and further testing, we’ve finally generated our 2nd release candidate for Greenstone 2.84. This time, there’s also a binary for the MacOS (tested on Leopard).

Most of the bugs this time round (after Release Candidate 1) had to do with dynamically linked libraries on the MacOs, getting the new document plugins from Greenstone Extensions to work when the Greenstone server is on a remote machine, Imagemagick processing JPEG2000 images on Linux machines, and fixing some issues around installing Greenstone on Windows in a path containing spaces.

Things seem to look good so far (but we’d appreciate independent confirmation of it), so if you haven’t already, do grab a copy and try it out. And tell us about your discoveries: any difficulties, bugs or other insights, so that we can make the final release of Greenstone 2.84 perfect.

Greentone 2.84 has cool new features, including the long-awaited ability to process docx and other new Office formats, as well as recent versions of PDF documents. These features are available as extensions to Greenstone, for which the details can be found in the Release Notes.

Download the Greenstone 2.84 RC2 from the Snapshots page.

The Greenstone wiki page 2.84 Release Notes has information on installation, running, where to get the new Greenstone extensions and more.

Greenstone-Koha Integrated LIVE CD v0.6

admin. Wednesday, November 3rd, 2010

HealthNet Nepal in Kathmandu has released a pilot version of the Greenstone-Koha Integrated LIVE CD on 15th October, 2010, in the framework of the Digital Library Network South Asia (DLNET-SA). The LIVE CD enables anyone with a PC to test and learn about Greenstone, the Koha integrated library system package and the application integrating these packages. Thanks are due to DLConsulting for their help in developing in the integration application and to Dr. ARD Prasad at DRTC in Bangalore for assistance in developing the LIVE CD. DLNET-SA hopes that this effort can go further and get better and better.

In this LIVE CD, there is Ubuntu with minimal a GNOME Desktop pre-configured with:

1. Greenstone Digital Library Software

2. Koha Integrated Library System

3. GSDL – Koha Integration

4. Sample Integration data

The CD Image (ISO) can be downloaded freely from Sourceforge at http://sourceforge.net/projects/gsdlkohalive/. For detailed information about the features and facts you can visit http://gsdlkohalive.sourceforge.net/.

We are constantly trying to improve this CD and come up with latest version in the upcoming releases. The current version is called v0.6 is based on Ubuntu 10.4 (32 bits) and has the following versions of applications:

1. GSDL v2.83

2. KOHA v3.2.0

Announcement released on behalf of Dr. Mohan Raj Pradhan, General Secretary, DLNET-SA

Results from the Greenstone User and Developer Survey

admin. Tuesday, June 22nd, 2010

We are pleased to announce that an overview of results from the 2009 Greenstone User and Developer survey is available online at: http://greenstonesurvey.wordpress.com/greenstone-user-and-developer-survey-results/.

Through the survey, we were able to gather information from a geographically dispersed group of organizations and individuals who use Greenstone Digital Library Software. A primary component of the survey focused on how support resources are used and how current resources meet user needs.

The overview includes results from all major sections of the survey, which were the following:

  • Background information (modes of use and basic use demographics);
  • User Satisfaction;
  • Support Mechanisms and Resources;
  • Organizational Contexts;
  • Technical Environments (Version Use and OS);
  • Collections and Audiences; and
  • Developers.

We’d like to thank respondents for participating in the survey and sharing information about their Greenstone experience!

First operational Greenstone OAI-PMH collections

admin. Thursday, December 24th, 2009

The first two Greenstone collections to publicly implement OAI-PMH (Open Archives Initiative – Protocol for Metadata Handling) are now fully operational for data harvesting.

They are:

* Biblioteca Digital Científica de les Illes Balears in Spain – the OAI base url is http://ibdigital.uib.es/greenstone/cgi-bin/oaiserver.cgi;
* Memoria Académica of the Faculty of Humanities and Educational Sciences, National University of La Plata in Argentina – the OAI base url is http://www.memoria.fahce.unlp.edu.ar/oaiserver.cgi.

Both of these collections are registered in ROAR, OpenDoar and the Open Archives list of Data Providers.

By activating the integrated OAI-PMH Greenstone server, a Greenstone collection can participate in the worldwide open access network by which bibliographic data is made freely available by more than a thousand OAI-PMH data providers (often called open access repositories or institutional archives).

Several other Greenstone collections are referenced the above registries (7 in ROAR, 19 in OpenDoar which does not require OAI-PMH access for listing) but these collections have either not implemented OAI-PMH, or not correctly parameterised their server, or not correctly registered their service.

Interested users may consult the OAI support page on the Greenstone wiki.

In addition to providing an OAI-PMH server, Greenstone has integrated OAI-PMH harvester (in the Download tab in GLI) which permits the acquisition of data from OAI-PMH servers to enrich Greenstone collections; in addition to the access to bibliographic data as defined in the OAI-PMH protocol, this harvesting facility also enables downloading of the associated documents if they are referenced in the OAI-PMH records.

Users’ comments are invited on OAI in Greenstone, e.g. on technical issues or facility of use, on other existing operational collections unknown to us, or on plans for new OAI-PMH Greenstone services.