1 2011-04-18T00:34:55 *** ronny
2 2011-04-18T00:38:04 *** ronny
3 2011-04-18T02:02:10 *** MattMaker
4 2011-04-18T02:29:06 *** MattMaker
5 2011-04-18T03:56:21 *** MattMaker
6 2011-04-18T04:20:50 *** MattMaker_
7 2011-04-18T04:23:29 *** MattMaker
8 2011-04-18T04:23:30 *** MattMaker_
9 2011-04-18T05:24:13 *** MattMaker
10 2011-04-18T05:38:16 *** Marchael
11 2011-04-18T05:38:40 <Marchael> moin
12 2011-04-18T05:39:28 *** MattMaker
13 2011-04-18T06:08:10 *** kursor
14 2011-04-18T06:12:39 *** kursor
15 2011-04-18T06:35:03 *** kursor
16 2011-04-18T06:39:43 *** kursor
17 2011-04-18T06:44:36 *** ronny
18 2011-04-18T07:39:58 *** ronny
19 2011-04-18T08:27:45 *** gwork
20 2011-04-18T09:47:04 *** z^ck
21 2011-04-18T09:49:08 <ThomasWaldmann> moin
22 2011-04-18T10:26:40 *** ronny
23 2011-04-18T10:30:43 *** ronny
24 2011-04-18T11:26:30 *** greg_f
25 2011-04-18T12:25:01 *** ronny
26 2011-04-18T12:25:14 *** Marchael
27 2011-04-18T13:02:13 *** Marchael
28 2011-04-18T15:06:25 *** eSyr
29 2011-04-18T15:08:59 <ThomasWaldmann> xorAxAx: waldi: dreimark: we should talk today evening about mentoring / slots, etc. - is 20:15 localtime ok for you?
30 2011-04-18T15:09:35 <xorAxAx> nope
31 2011-04-18T15:09:52 <xorAxAx> earlier or 22:45 and later
32 2011-04-18T15:10:31 <ThomasWaldmann> xorAxAx: waldi: dreimark: we should talk today evening about mentoring / slots, etc. - is 19:00 localtime ok for you?
33 2011-04-18T15:10:44 <xorAxAx> sounds good
34 2011-04-18T15:11:43 *** eSyr
35 2011-04-18T15:11:52 <waldi> okay
36 2011-04-18T15:12:33 <ThomasWaldmann> xorAxAx: waldi: dreimark: please look through all proposals before that and make up your mind whether you would also mentor others than those you already told so in melange
37 2011-04-18T15:13:23 <Marchael> hm, it looks like good time for updating my proposal :)
38 2011-04-18T15:13:30 <ThomasWaldmann> (i.e. whether we should accept a student that is maybe rather a beginner and a had a not-so-great proposal)
39 2011-04-18T15:13:54 <ThomasWaldmann> Marchael: :D
40 2011-04-18T15:17:51 <Marchael> ThomasWaldmann: I think it's never too late :)
41 2011-04-18T16:09:45 <ThomasWaldmann> Marchael: google for "never give up" and see the frog picture :)
42 2011-04-18T16:14:16 <Marchael> ThomasWaldmann: yeah, it's really motivating me
43 2011-04-18T16:21:06 <Marchael> ThomasWaldmann: could you describe me your minds why whoosh will be better for moin than xapian?
44 2011-04-18T16:23:02 <TheSheep> Marchael: it doesn't require you to install anything
45 2011-04-18T16:23:12 <TheSheep> Marchael: you can just ship it with moin's sources
46 2011-04-18T16:24:37 <Marchael> TheSheep: and what about opportunities?
47 2011-04-18T16:25:44 <TheSheep> Marchael: what about them?
48 2011-04-18T16:26:08 *** kursor
49 2011-04-18T16:26:48 <ThomasWaldmann> Marchael: because it is no binary dependency, but pure python, we do not need to provide an alternative for it
50 2011-04-18T16:27:09 <ThomasWaldmann> like we did in moin 1.9 with builtin slow search + xapian
51 2011-04-18T16:27:44 <Marchael> TheSheep: whoosh can find documents as fast as xapian? Xapian is 'easy to use' like whoosh?
52 2011-04-18T16:28:13 <ThomasWaldmann> that makes the code definitely simpler and also life easier for the users because the behaviour of the search won't depend on the configuration chosen by the admin who installed moin
53 2011-04-18T16:29:49 <ThomasWaldmann> xapian (C-code) is likely faster than whoosh, but that seems not to apply that much to xapian-via-xappy
54 2011-04-18T16:51:34 <TheSheep> omg, the test_rst.py uses sys._get_frame() O.o
55 2011-04-18T16:57:41 <Marchael> ThomasWaldmann: Do you meant what xappy not provide all functionality of xapian?
56 2011-04-18T16:58:34 <ThomasWaldmann> TheSheep: huh? :)
57 2011-04-18T16:58:48 <TheSheep> ThomasWaldmann: apparently to check where it was called from
58 2011-04-18T16:59:14 <ThomasWaldmann> Marchael: i guess it provided all we needed.
59 2011-04-18T16:59:37 <TheSheep> ThomasWaldmann: http://hg.moinmo.in/moin/1.9/file/c12c28282eab/MoinMoin/parser/text_rst.py#l247
60 2011-04-18T17:00:01 <ThomasWaldmann> but i have seen some strange benchmark of someone (whoosh author) that showed that xappy is quite slower than xapian usage without xappy (but just with the python binding)
61 2011-04-18T17:04:47 <ThomasWaldmann> (but this is not the reason why we change to whoosh, i don't think we ever had a speed issue with xappy/xapian)
62 2011-04-18T17:11:24 *** gwork
63 2011-04-18T17:15:17 *** MattMaker_
64 2011-04-18T17:17:42 *** MattMaker
65 2011-04-18T17:17:42 *** MattMaker_
66 2011-04-18T18:03:54 <xorAxAx> ThomasWaldmann: is 30 min. enough for today?
67 2011-04-18T18:04:02 <xorAxAx> because i will be gone at 19:30
68 2011-04-18T18:05:09 <ThomasWaldmann> well, depends on how prepared people are :)
69 2011-04-18T18:06:33 * ThomasWaldmann commented on Marchael's proposal
70 2011-04-18T18:06:53 <Marchael> yes, I saw it.
71 2011-04-18T18:07:11 * Marchael start updating his proposal
72 2011-04-18T18:07:43 <ThomasWaldmann> always think ahead
73 2011-04-18T18:08:02 <ThomasWaldmann> like "what could possibly go wrong if i do it that way?" :)
74 2011-04-18T18:08:42 <Marchael> yes yes, I change some stuff related with sqla
75 2011-04-18T18:09:29 <ThomasWaldmann> and we really need proposal diffs for next soc
76 2011-04-18T18:17:21 <Marchael> ThomasWaldmann: I won't remove sqla code related with indexing until I will haven't working indexing with whoosh
77 2011-04-18T18:23:36 <ThomasWaldmann> you need searching also, not just indexing
78 2011-04-18T18:24:43 <xorAxAx> as there is no diff view for proposal updates, i wont respect them when judging students :-P
79 2011-04-18T18:31:10 <Marchael> update info about indexing
80 2011-04-18T18:38:43 *** kursor
81 2011-04-18T19:00:14 <ThomasWaldmann> dreimark: you remember the meeting?
82 2011-04-18T19:01:06 <xorAxAx> did he ack it?
83 2011-04-18T19:21:59 <Marchael> update timeline
84 2011-04-18T19:22:13 <Marchael> *updated
85 2011-04-18T19:26:50 *** kursor
86 2011-04-18T19:29:10 *** kursor_
87 2011-04-18T19:29:21 *** kursor
88 2011-04-18T19:29:22 *** kursor_
89 2011-04-18T19:31:12 <Marchael> I found how whoosh could use regexes http://packages.python.org/Whoosh/parsing.html#changing-the-and-or-andnot-andmaybe-and-not-tokens
90 2011-04-18T19:32:08 <Marchael> so I can use qparser.CompoundsPlugin for defining simple regexps
91 2011-04-18T19:34:37 <Marchael> ThomasWaldmann: ^
92 2011-04-18T19:36:19 <Marchael> be right back in 1 hour
93 2011-04-18T19:36:21 *** Marchael
94 2011-04-18T19:52:16 *** Marchael
95 2011-04-18T19:54:13 <Marchael> oh, I lost my hostel ticket while runnig under the rain
96 2011-04-18T19:54:42 <Marchael> I think it victim will not be vain
97 2011-04-18T19:54:45 <Marchael> :)
98 2011-04-18T19:55:57 <ThomasWaldmann> are you on vacation / travelling?
99 2011-04-18T19:56:53 <Marchael> No, I just want to spent this night in university but security don't think so
100 2011-04-18T20:01:02 *** greg_f
101 2011-04-18T20:21:56 *** RogerHaase
102 2011-04-18T20:24:56 *** Marchael
103 2011-04-18T20:26:28 *** kursor
104 2011-04-18T20:32:50 <ThomasWaldmann> note to self: fix typo in whoosh docs "ixreaderder"
105 2011-04-18T20:50:31 <RogerHaase> ThomasWaldman: Read your email, I am interested in co-mentoring UI, but am concerned about the amount of time required. My schedule is hectic and it will remain so through the summer.
106 2011-04-18T20:53:09 <ThomasWaldmann> hi roger
107 2011-04-18T20:53:42 <ThomasWaldmann> well, the main work shall be done by the student. :) but of course, depending on the student, more or less help will be required.
108 2011-04-18T20:56:36 <RogerHaase> On any given week, I may be unavailable 3 or 4 days, with only a few hours available on the other days. Plus there may be time zone issue as I am GMT -7.
109 2011-04-18T20:57:15 <TheSheep> you can get a student from the same timezone ;)
110 2011-04-18T20:58:43 *** Marchael
111 2011-04-18T20:59:26 <Marchael> oh, provider of my university shutdown internet connection for maintence
112 2011-04-18T20:59:41 <RogerHaase> But I am willing to give it a go as a co-mentor or maybe "mentors assistant" (if I can make up my own job title).
113 2011-04-18T20:59:53 <Marchael> I will remember this night...
114 2011-04-18T21:01:28 <ThomasWaldmann> RogerHaase: with a schedule that tight, maybe co-mentoring is better
115 2011-04-18T21:02:05 <ThomasWaldmann> Marchael: no place to sleep?
116 2011-04-18T21:03:57 <Marchael> ThomasWaldmann: hm, I'm trying write something for improving my proposal. I don't need sleep :)
117 2011-04-18T21:04:07 <ThomasWaldmann> hehe
118 2011-04-18T21:04:33 *** ronny
119 2011-04-18T21:04:57 <ThomasWaldmann> Marchael: btw, the regex stuff will get a bit tricky and likely SLOW
120 2011-04-18T21:05:15 <Marchael> ThomasWaldmann: I updated my proposal, did you read this?
121 2011-04-18T21:05:18 <ThomasWaldmann> maybe not slower than with moin 1.9's slow builtin search, though
122 2011-04-18T21:05:44 <Marchael> ThomasWaldmann: as you say, normal user doesn't need this :)
123 2011-04-18T21:05:50 <ThomasWaldmann> Marchael: i miss diffs. melange always sends me full text.
124 2011-04-18T21:06:06 <ThomasWaldmann> but i'll read it later today
125 2011-04-18T21:10:35 <Marchael> hmmm, you say what you will discuss something with other mentors about stundets proposals, I'll thought what today is dedline.
126 2011-04-18T21:12:54 <ronny> re
127 2011-04-18T21:15:37 <ThomasWaldmann> Marchael: we had already a little meeting. but we can't tell results here. and it is not final anyway until you hear it from google.
128 2011-04-18T21:25:38 <Marchael> ThomasWaldmann: so, could you review my timeline?
129 2011-04-18T21:29:46 *** Marchael
130 2011-04-18T21:30:03 *** Marchael
131 2011-04-18T21:33:08 <ThomasWaldmann> "it looks a bit better" :)
132 2011-04-18T21:33:30 <Marchael> :(
133 2011-04-18T21:33:47 <ThomasWaldmann> ah, still there :)
134 2011-04-18T21:34:44 <ThomasWaldmann> (I only looked at timeline right now btw)
135 2011-04-18T21:37:18 <ThomasWaldmann> the regex stuff will get a bit complicated at multiple places
136 2011-04-18T21:37:36 <ThomasWaldmann> you'll have to extend qp to be able to use some syntax for it
137 2011-04-18T21:38:20 <ThomasWaldmann> after query parsing, when searching, well, you'll have to search for a regex, which is not supported by whoosh afaics
138 2011-04-18T21:39:00 <ThomasWaldmann> so, you'll likely end up with searching for "everything" and doing the regex match yourself
139 2011-04-18T21:39:59 <ThomasWaldmann> that's of course slow, esp. if your index is some gigabytes
140 2011-04-18T21:40:50 <ThomasWaldmann> and I guess you'ld maybe need some help from mchaput for such stuff
141 2011-04-18T21:41:28 <Marchael> ThomasWaldmann: May be I should first once parse query, then determines what there is regexp or no, and then parse it again.
142 2011-04-18T21:41:50 <Marchael> *parse as regexp
143 2011-04-18T21:42:25 <ThomasWaldmann> i didn't look too deeply, but you maybe can find out also in the result of parsing
144 2011-04-18T22:02:35 * Marchael answered on all reply in melange
145 2011-04-18T22:02:57 <Marchael> *replyies
146 2011-04-18T22:04:59 <ThomasWaldmann> KeyError :)
147 2011-04-18T22:06:37 <Marchael> where?
148 2011-04-18T22:11:14 <ThomasWaldmann> KeyError means that it is not in the dictionary. :D
149 2011-04-18T22:12:14 <Marchael> Parser Error: Unknow error
150 2011-04-18T22:12:28 <Marchael> :)
151 2011-04-18T22:32:30 <Marchael> ThomasWaldmann: you still here?
152 2011-04-18T22:33:48 <ThomasWaldmann> yes
153 2011-04-18T22:34:05 <Marchael> what syntax for regexp I need to provide?
154 2011-04-18T22:35:24 <Marchael> And why whoosh`s CompoundsPlugin not enoght for regexes?
155 2011-04-18T22:35:53 <ThomasWaldmann> because that's only for the query parser?
156 2011-04-18T22:36:17 <ThomasWaldmann> and it is rather intended for something like and or or.
157 2011-04-18T22:36:51 <ThomasWaldmann> you also need to do the real searching somehow
158 2011-04-18T22:38:09 <Marchael> do you meant searching with CompoundsPlugin?
159 2011-04-18T22:42:27 <ThomasWaldmann> i meant searching for stuff matching a regex with whoosh
160 2011-04-18T22:45:57 <ThomasWaldmann> e.g. if the user enters something like re:Fo+Ba+r
161 2011-04-18T22:46:43 <ThomasWaldmann> it should find text like FooBar, FooooBaaaar, FoBar etc.
162 2011-04-18T22:47:28 <ThomasWaldmann> (if re: means that a regex search term is following, as it used to be in 1.9)
163 2011-04-18T22:51:19 <Marchael> ThomasWaldmann: ok, but I'm not sure what whoosh support "+"
164 2011-04-18T22:51:32 <Marchael> or something like
165 2011-04-18T22:52:00 <ThomasWaldmann> as i said: it likely does not
166 2011-04-18T22:58:15 *** Marchael
167 2011-04-18T22:59:23 *** Marchael
168 2011-04-18T23:07:14 *** Marchael
169 2011-04-18T23:53:01 *** RogerHaase
170
