MoinMoin: MoinMoinChat/Logs/moin-dev/2009-07-31

2009-07-31T00:05:06  *** grzywacz has joined #moin-dev
2009-07-31T00:55:30  *** grzywacz has quit IRC
2009-07-31T04:12:55  *** amartani has joined #moin-dev
2009-07-31T04:25:15  <amartani> dennda: ThomasWaldmann: enduser backend fails if you don't have mercurial installed, when it imports hg backend
2009-07-31T04:26:02  <amartani> can it be imported only if hg backend is used?
2009-07-31T04:33:40  <amartani> like: http://paste.pocoo.org/show/131846/
2009-07-31T05:04:29  *** amartani has quit IRC
2009-07-31T05:07:32  *** amartani has joined #moin-dev
2009-07-31T06:25:30  *** amartani has quit IRC
2009-07-31T06:26:10  *** amartani has joined #moin-dev
2009-07-31T08:09:07  <CIA-43> Alexandre Martani <amartani AT gmail DOT com> default * 6399:4c2dc8d99d1c 2.0-storage-editor-amartani/MoinMoin/config/multiconfig.py: Real-time editor: Add preference editor_mobwrite_mode
2009-07-31T08:09:08  <CIA-43> Alexandre Martani <amartani AT gmail DOT com> default * 6400:6518c34f99b9 2.0-storage-editor-amartani/MoinMoin/ (3 files in 3 dirs): Real-time editor: Create get_worker method to select which worker to use (in-process or daemon) from configuration. Made action and item use it to get worker.
2009-07-31T08:43:15  <ThomasWaldmann> amartani: wikiserver.py is reading wikiconfig.py instead of wikiserverconfig.py ?
2009-07-31T09:17:52  <ThomasWaldmann> amartani: what does that do exactly?:
2009-07-31T09:17:54  <ThomasWaldmann>      3.7 -STORAGE_MODE = BDB
2009-07-31T09:17:54  <ThomasWaldmann>      3.8 +STORAGE_MODE = MEMORY
2009-07-31T10:15:46  <_peck_> q
2009-07-31T13:13:39  <dennda> hm
2009-07-31T13:13:59  <dennda> ThomasWaldmann: will hg be included in moin (kitchensink)?
2009-07-31T13:17:24  <ThomasWaldmann> no
2009-07-31T13:38:47  <ThomasWaldmann> dennda: if it still requires compiliation of some C code, that would be impossible, if not, it would be at least unwanted, due to its size
2009-07-31T14:55:20  *** devilsadvocate has joined #moin-dev
2009-07-31T15:25:00  <dennda> oh?
2009-07-31T15:26:11  <dennda> I didn't know it had any binary stuff and thought it was rather small in size
2009-07-31T15:26:12  <dennda> ok then
2009-07-31T15:52:48  <amartani> moin
2009-07-31T15:54:35  <xorAxAx> hi amartani
2009-07-31T15:55:01  <amartani> ThomasWaldmann: then I start wikiserver.py, shouldn't it get configuration from wikiserverconfig.py?
2009-07-31T15:56:54  <dennda> wikiconfig.py
2009-07-31T15:59:24  <amartani> dennda: it is getting from wikiconfig.py, but it should get from wikiserverconfig.py
2009-07-31T15:59:29  <amartani> (i think)
2009-07-31T16:16:58  <ThomasWaldmann> amartani: wikiserverconfig and wikiconfig are for different purposes
2009-07-31T16:17:25  <ThomasWaldmann> 1st configures the standalone server, 2nd configures moin
2009-07-31T16:24:31  <amartani> ah, I got it
2009-07-31T16:25:12  <amartani> thanks for the comments on the wiki page
2009-07-31T17:02:51  <CIA-43> Christopher Denter <moin GUESSWHAT the DASH space DASH station ROUNDTHING com> default * 6306:9ad922c39089 2.0-storage/MoinMoin/storage/backends/enduser.py: storage: Import hg backend only if necessary because it imports an external program that we cannot easily ship with moin
2009-07-31T17:02:54  <CIA-43> Christopher Denter <moin GUESSWHAT the DASH space DASH station ROUNDTHING com> default * 6307:ba041c052607 2.0-storage/MoinMoin/ (action/syspages_upgrade.py templates/action_query.html): storage: Redo the syspage_upgrade action. Use proper jinja template.
2009-07-31T17:04:26  <dennda> why didn't I do that in the first place? Took a bit to figure out but that's definitely better than copy&paste-coding ;)
2009-07-31T17:09:46  <ThomasWaldmann> :)
2009-07-31T17:14:08  <dennda> now I need to fight with cyclic import hell
2009-07-31T17:22:19  <CIA-43> Christopher Denter <moin GUESSWHAT the DASH space DASH station ROUNDTHING com> default * 6308:7c756a3972f2 2.0-storage/MoinMoin/ (3 files in 3 dirs): storage: Fix imports.
2009-07-31T17:27:15  <CIA-43> Dmitrijs Milajevs <dimazest@gmail.com> default * 4928:43e7b40912ac 1.9-xapian-dmilajevs/MoinMoin/search/ (__init__.py builtin.py): Xapian2009: The MoinMoin.search.builtin.Search class was split to BaseSearch, MoinSearch and XapianSearch. Search using moin should work, xapian search is broken!
2009-07-31T17:27:18  <CIA-43> Dmitrijs Milajevs <dimazest@gmail.com> default * 4929:21bc8092a009 1.9-xapian-dmilajevs/MoinMoin/search/Xapian.py:
2009-07-31T17:27:18  <CIA-43> Xapian2009: Search is done using xappy.
2009-07-31T17:27:18  <CIA-43> Xapian.Index indexValueMap and prefixMap were killed, no need to add terms for xappy.
2009-07-31T17:27:19  <CIA-43> Field actions were revised.
2009-07-31T17:43:18  <dennda> ThomasWaldmann: So, now a user has a proper interface, metadata is also there. Should I know rip out all the underlay stuff (sounds like a big thing)? Do you want me to write a script that removes outdated system pages (we'd need to define what that means)?
2009-07-31T17:44:17  * dennda has a cold. I hope it's not swine flu. %-)
2009-07-31T17:44:42  <ThomasWaldmann> dennda: yes, rip out all underlay stuff
2009-07-31T17:45:19  <ThomasWaldmann> the sys pages detection has to be based on the is_systempage metadata
2009-07-31T17:46:19  <dennda> yes sure, but do you want *me* to write such a script *now*? :-)
2009-07-31T17:46:22  <dennda> that was my question
2009-07-31T17:46:52  <ThomasWaldmann> well, at least you have to make the path 1.9 -> 2.0 working
2009-07-31T17:52:48  <dennda> ThomasWaldmann: Speaking of the not yet released moin? If a user edited a page from underlay which then ended up in his data, how would I know?
2009-07-31T17:59:17  <ThomasWaldmann> well, if the sys page still exists, you would have a collision
2009-07-31T17:59:39  <dennda> hm why?
2009-07-31T17:59:41  <ThomasWaldmann> if not, the user can fix it manually when he sees sys pages on TitleIndex
2009-07-31T18:00:14  <ThomasWaldmann> well, if the sys page still exists (in 2.0 sys pages), you would have a collision (with user page)
2009-07-31T18:01:32  <dennda> why? If the thing already exists (because it got into the users wiki data when it was edited) the new syspage is added as new rev to that already existing item
2009-07-31T18:13:28  <ThomasWaldmann> right, that means you handle the collision by just adding a new rev
2009-07-31T18:13:44  <dennda> afair we decided to do so
2009-07-31T18:16:20  <dennda> wiki/syspages.xml: files over 10MB may cause memory and performance problems
2009-07-31T18:16:52  <dennda> it's only 4 mb if I tar and gzip it
2009-07-31T18:19:09  <dennda> (why did I tar it actually?)
2009-07-31T18:19:21  * ThomasWaldmann asks that himself, too
2009-07-31T18:19:56  <ThomasWaldmann> btw, just putting all those xml contents into a flatfile backend seems to be not far fetched
2009-07-31T18:21:09  <dennda> my plan was: ungzip, put into stringio, unserialize from stringio to membackend, convert membackend -> real backend
2009-07-31T18:21:22  <dennda> where exactly do you want to use the ff backend?
2009-07-31T18:24:24  <ThomasWaldmann> and where does the data come from?
2009-07-31T18:24:47  <dennda> from syspages.xml.gz?
2009-07-31T18:25:00  <ThomasWaldmann> where is that file located?
2009-07-31T18:25:15  <dennda> wiki/
2009-07-31T18:26:03  <ThomasWaldmann> I don't think you will be easily able to locate that
2009-07-31T18:26:34  <dennda> I was talking about creation of persistent dev wiki
2009-07-31T18:26:51  <ThomasWaldmann> I am talking about something usable by $ENDUSER
2009-07-31T18:27:24  <dennda> well
2009-07-31T18:27:31  <dennda> let's play it through
2009-07-31T18:28:40  <dennda> Joe has set up a new 2.0 wiki. Underlay is not taken into consideration anymore. In the worst case, he still has some leftovers from manual editing. If that is the case, those will just be overwritten when he performs the syspage upgrade via the UI
2009-07-31T18:31:47  <ThomasWaldmann> continue...
2009-07-31T18:33:00  <dennda> at some point a new syspage version comes out, he performs the upgrade again, old versions are overwritten (and outdated ones may be removed)
2009-07-31T18:33:27  <ThomasWaldmann> you didn't tell about how it works exactly
2009-07-31T18:35:57  <dennda> which part do you want to know more about?
2009-07-31T18:42:14  <ThomasWaldmann> maybe begin with "joe doe downloads moin20.tar.gz"
2009-07-31T18:42:42  <ThomasWaldmann> or uses apt-get install moin20
2009-07-31T18:43:05  <dennda> well yes
2009-07-31T18:43:36  <dennda> It seems I fail to see where a conversion is necessary
2009-07-31T18:44:37  <dennda> well for underlay
2009-07-31T18:45:07  <dennda> for everything in his wiki/data and wiki/user folder he just uses the migration script
2009-07-31T18:45:26  <dennda> which then clones that stuff to his new backend (which he defined in the config prior to conversion)
2009-07-31T18:45:38  <dennda> then he eventually decides he wants syspages and uses the UI to add them
2009-07-31T18:51:09  <CIA-43> Christopher Denter <moin GUESSWHAT the DASH space DASH station ROUNDTHING com> default * 6309:f7a35231fba8 2.0-storage/MoinMoin/storage/__init__.py: storage: forgot to remove import
2009-07-31T18:51:11  <CIA-43> Christopher Denter <moin GUESSWHAT the DASH space DASH station ROUNDTHING com> default * 6310:4e2a9cbe6414 2.0-storage/ (4 files in 2 dirs): storage: remove underlay.tar. Replace by syspages.xml.gz. Make dev wiki initialization script work with that
2009-07-31T18:55:54  <ThomasWaldmann> you wanted to step it through, why don't you just do that?
2009-07-31T18:57:09  <dennda> User installs moin2.0, user configures new wiki instance (providing a backend_uri), user performs migration of old data into new backends if necessary by invoking the migration script with a path to the old data and the backend uri
2009-07-31T18:57:24  <dennda> user wants syspages, user invokes syspages_upgrade action
2009-07-31T18:57:36  <dennda> user repeatedly does that for new versions of the syspages
2009-07-31T18:59:46  <dennda> hmmm how would I open all the files containing "underlay" as a string in my editor one after the other? (there's a *huge* pile of files with underlay)
2009-07-31T19:02:13  <ThomasWaldmann> how does he invoke syspages_upgrade action?
2009-07-31T19:02:26  <ThomasWaldmann> what's happening then?
2009-07-31T19:02:37  <dennda> by selecting it from the list of actions in the UI
2009-07-31T19:02:45  <dennda> he needs to be superuser for that
2009-07-31T19:02:50  <ThomasWaldmann> and then?
2009-07-31T19:02:56  *** grzywacz has joined #moin-dev
2009-07-31T19:02:56  <dennda> oh actually I think i forget to add that check
2009-07-31T19:03:33  <dennda> then he provides an item that contains all the xml content. here is the problem. how does that content get there?
2009-07-31T19:03:57  <ThomasWaldmann> (see my flatfile suggestion above)
2009-07-31T19:04:20  <ThomasWaldmann> and there is no "all the xml content", we have quite a lot of different xml files
2009-07-31T19:04:38  <ThomasWaldmann> for different amount of sys pages in different languages (see 1.9 beta3)
2009-07-31T19:04:50  <dennda> i was under the impression there will be one big xml file containing all the syspages
2009-07-31T19:04:59  <dennda> for one language
2009-07-31T19:05:29  <ThomasWaldmann> almost. there are people who just want essential syspages, others want also more help pages, course pages, ...
2009-07-31T19:05:47  <ThomasWaldmann> so, expect about 100 xml files
2009-07-31T19:07:20  <dennda> how exactly does that correlate with the flatfile backend now?
2009-07-31T19:16:38  <ThomasWaldmann> you could have a bunch of xml items in there
2009-07-31T19:16:47  <ThomasWaldmann> and just mount it for installation somewhere
2009-07-31T19:17:12  <ThomasWaldmann> if we solve the rootpage name thing, we could even mount it at LanguageSetup :)
2009-07-31T19:17:16  <dennda> ah i confused flatfile and fs19
2009-07-31T19:34:43  <ThomasWaldmann> brb
2009-07-31T20:12:46  <ThomasWaldmann> re
2009-07-31T21:02:02  <ThomasWaldmann> dennda: still alive?
2009-07-31T21:37:23  *** devilsadvocate has quit IRC
2009-07-31T21:37:39  *** devilsadvocate has joined #moin-dev
2009-07-31T22:11:12  *** dreimark2 has joined #moin-dev
2009-07-31T22:11:35  <dreimark2> moin
2009-07-31T22:12:25  <dreimark2> greetings from moinmoin country
2009-07-31T22:20:31  <ThomasWaldmann> hehe. you are in northern germany?
2009-07-31T22:29:29  <ThomasWaldmann> dennda: look at that and think about it vv
2009-07-31T22:29:47  <CIA-43> Thomas Waldmann <tw AT waldmann-edv DOT de> default * 6311:53af5d6791c7 2.0-storage/ (wikiserver.py wiki/syspages.xml wiki/syspages.xml.gz): wikiserver: make backend check more sane, remove unneeded code, do not store .gz files in repo (bdiff does not work good with them)
2009-07-31T22:40:09  *** dreimark2 has quit IRC
2009-07-31T23:05:38  <CIA-43> Thomas Waldmann <tw AT waldmann-edv DOT de> default * 6312:0bbb1e4fa6cc 2.0-storage/ (MoinMoin/storage/serialization.py wiki/syspages.xml): remove noacl hack, not needed
2009-07-31T23:36:53  <CIA-43> Thomas Waldmann <tw AT waldmann-edv DOT de> default * 6313:68429991eb6a 2.0-storage/MoinMoin/ (_tests/wikiconfig.py security/_tests/test_security.py): fix security tests for create capability