Mokopedia

From Openmoko

(Difference between revisions)
Jump to: navigation, search
(wiki)
 
(32 intermediate revisions by 10 users not shown)
Line 1: Line 1:
{{todo|Support this project by adding ideas and comments to the discussion page and edit this article}}
+
[[Image:Mokopedia_main.png|thumb|150px|''Mokopedia running on Openmoko'']]
  
Mokopedia intends to make wikipedia accessible on your phone even without being online because all articles will reside bzipped on an SD Card.
+
{{application|Mokopedia}}
It's now rewritten in python and uses pythons gtkhtml2 binding (not available yet on openmoko - fgau is working on it) and bzip2 binding to do everything the former version in c did.
+
Please submit more feature ideas!
+
  
==Feature Ideas==
+
{{ApplicationBox|
Please feel free to add anything that comes to your mind.
+
Name=[[Mokopedia]]|
*show articles depending on location (GPS)
+
Description=Read Wikipedia offline from small optimized dumps|
*list with
+
Screenshot=Mokopedia_main.png|
**recently viewed articles (history)
+
Homepage=http://mokopedia.mister-muffin.de/|
**most viewed articles
+
TestedOn=-|
*search articles "as you type" (benchmarks on a neo with searching in large text files proove such things to be impossible due to processor slowness)
+
PackageName=no package yet
*it will have no pictures - not enough room on any storage media
+
}}
*tex forumlas could be generated with a local LaTeX install but this may be too big for the phone
+
*all wikipedia versions except the english one will fit on a 1GB SDCard (tested with the second largest wikipedia (german)) - compressability tests with en-wiki in progress
+
*all articles will be bzipt in seperate files - 7zip/lzma only performs better than bzip with really big files due to it's dictionary and it's also much slower and eats much more memory
+
*new wikipedia versions can be obtained from here [http://static.wikipedia.org/] and can then be optimzed with a perl script I wrote
+
*option for varying the text size
+
*settings dialog
+
**set articles location
+
*forward/back buttons
+
*bookmarks
+
*support for stripped down wikipedia versions (100MB, 500MB) with only the most viewed articles for users with storage restrictions
+
**if an article is not available locally - ask the user if it should download it form the web
+
*Scan SMS and emails for keywords of current events (extracted from a news feed) or foreign words and automagically crossreference them to the respective article of the offline wikipedia.
+
  
==Development Status==
+
This project aims to provide software to create and use small size wikipedia dumps for embedded Linux devices.
  
*UTF-8 capable article viewer
+
All Wikipedia pages will be stripped down html files compressed in a squashfs lzma image.
*read bzip2 compressed articles
+
  
You can obtain the current version of the little mokopedia python script on http://www.rabenfrost.net/mokopedia.py. The article which is shown is hardcoded. The demo article is an optimzed version of "Alexander the Great http://www.rabenfrost.net/Alexander_the_Great.html.bz2
+
For more info visit the official website: http://mokopedia.mister-muffin.de/
  
[[Category:Add-on data]]
+
Join our irc channel on freenode: #mokopedia.
[[Category:Ideas]]
+
 
[[Category:Unimplemented]]
+
 
 +
It's the goal to make ALL the articles (except images) of Wikipedia (including formatting, linking, tables, formulas) fit on very little space.
 +
 
 +
Tests show that the German Wikipedia will be around 1.3GB and the English Wikipedia around 4GB so with flash storage prices dropping I will not bother removing certain articles - the dumps will include everything.
 +
 
 +
Some installation instructions can be found at
 +
http://rabenfrost.net/celtune/1-NEWS-WARNING-INFO (english) or
 +
http://seeseekey.net/blog/index.php?/archives/93-Mokopedia-einrichten.html (german).
 +
 
 +
 
 +
= Development status =
 +
 
 +
Some people are already running the new mokopedia on their freerunners but i wont announce any official info until enwiki isnt done so up to now there are only dewiki and others that are possible to use.
 +
 
 +
I you are interested to get it running on you freerunner join our irc channel and i will explain the few steps you have to take.
 +
 
 +
In the near feature there will be ipkgs for everything.
 +
 
 +
= To everybody that was familiar with the old implementation =
 +
 
 +
There is no lighty needed anymore - i now implement the server in a simple python script.
 +
 
 +
Now we have FULLTEXT search - yeah you hear right. a fulltext search through 6.8 GB of dewiki is possible in mere 20 seconds on the neo1973.
 +
 
 +
Now there are also a lot of things already implemented as ipkg - only the server is left but will follow soon.
 +
 
 +
[[Category:Applications]]

Latest revision as of 17:31, 19 July 2009

Mokopedia running on Openmoko

Mokopedia is one of the applications that runs on the Openmoko Phones. For a list of all applications, visit Applications

Mokopedia main.png Mokopedia

Read Wikipedia offline from small optimized dumps


Homepage: http://mokopedia.mister-muffin.de/
Package: no package yet
Tested on: -


This project aims to provide software to create and use small size wikipedia dumps for embedded Linux devices.

All Wikipedia pages will be stripped down html files compressed in a squashfs lzma image.

For more info visit the official website: http://mokopedia.mister-muffin.de/

Join our irc channel on freenode: #mokopedia.


It's the goal to make ALL the articles (except images) of Wikipedia (including formatting, linking, tables, formulas) fit on very little space.

Tests show that the German Wikipedia will be around 1.3GB and the English Wikipedia around 4GB so with flash storage prices dropping I will not bother removing certain articles - the dumps will include everything.

Some installation instructions can be found at http://rabenfrost.net/celtune/1-NEWS-WARNING-INFO (english) or http://seeseekey.net/blog/index.php?/archives/93-Mokopedia-einrichten.html (german).


[edit] Development status

Some people are already running the new mokopedia on their freerunners but i wont announce any official info until enwiki isnt done so up to now there are only dewiki and others that are possible to use.

I you are interested to get it running on you freerunner join our irc channel and i will explain the few steps you have to take.

In the near feature there will be ipkgs for everything.

[edit] To everybody that was familiar with the old implementation

There is no lighty needed anymore - i now implement the server in a simple python script.

Now we have FULLTEXT search - yeah you hear right. a fulltext search through 6.8 GB of dewiki is possible in mere 20 seconds on the neo1973.

Now there are also a lot of things already implemented as ipkg - only the server is left but will follow soon.

Personal tools
TODO: Support this project by adding ideas and comments to the discussion page and edit this article (See: To-Do List)

Mokopedia intends to make wikipedia accessible on your phone even without being online because all articles will reside bzipped on an SD Card. It's now rewritten in python and uses pythons gtkhtml2 binding (not available yet on openmoko - fgau is working on it) and bzip2 binding to do everything the former version in c did. Please submit more feature ideas!

Feature Ideas

Please feel free to add anything that comes to your mind.

  • show articles depending on location (GPS)
  • list with
    • recently viewed articles (history)
    • most viewed articles
  • search articles "as you type" (benchmarks on a neo with searching in large text files proove such things to be impossible due to processor slowness)
  • it will have no pictures - not enough room on any storage media
  • tex forumlas could be generated with a local LaTeX install but this may be too big for the phone
  • all wikipedia versions except the english one will fit on a 1GB SDCard (tested with the second largest wikipedia (german)) - compressability tests with en-wiki in progress
  • all articles will be bzipt in seperate files - 7zip/lzma only performs better than bzip with really big files due to it's dictionary and it's also much slower and eats much more memory
  • new wikipedia versions can be obtained from here [1] and can then be optimzed with a perl script I wrote
  • option for varying the text size
  • settings dialog
    • set articles location
  • forward/back buttons
  • bookmarks
  • support for stripped down wikipedia versions (100MB, 500MB) with only the most viewed articles for users with storage restrictions
    • if an article is not available locally - ask the user if it should download it form the web
  • Scan SMS and emails for keywords of current events (extracted from a news feed) or foreign words and automagically crossreference them to the respective article of the offline wikipedia.

Development Status

  • UTF-8 capable article viewer
  • read bzip2 compressed articles

You can obtain the current version of the little mokopedia python script on http://www.rabenfrost.net/mokopedia.py. The article which is shown is hardcoded. The demo article is an optimzed version of "Alexander the Great http://www.rabenfrost.net/Alexander_the_Great.html.bz2