Commit graph

50 commits

Author SHA1 Message Date
scrat
fc85114608 just accidentally created some pyc files. Checkin due to get a clean status again (to have the up-to-date symbols).
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@2498 fd906abe-77d9-0310-91a1-e0d9ade77398
2008-04-06 17:02:40 +00:00
helmutm
eee4e198c0 make runnable on Linux (ignore win imports conditionally); avoid hard-coded path and port setting
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@2105 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-10-09 07:19:17 +00:00
helmutm
999c25bf0b clean-up of doctests
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@2104 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-10-09 05:51:10 +00:00
tschmid
52538479d8 deferToThread implemented
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@2070 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-09-26 06:40:32 +00:00
tschmid
41e98f0bef initial check in
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@2069 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-09-25 06:31:14 +00:00
tschmid
cd18b551dc Outlook version check added
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@2068 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-09-23 18:13:16 +00:00
tschmid
e5eeb2d502 Outlook dialog handle added
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@2067 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-09-23 18:12:34 +00:00
helmutm
5473d625c9 provide short-hand syntax for config with repeated entries for one section
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@2059 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-09-19 07:27:22 +00:00
helmutm
465c8a963f provide short-hand syntax for config with repeated entries for one section
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@2058 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-09-19 07:26:31 +00:00
helmutm
9d888cefe8 provide short-hand syntax for config with repeated entries for one section
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@2057 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-09-19 07:23:35 +00:00
helmutm
57a5f126b5 upload of resources from loops.agent via HTTP PUT basically working
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1955 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-23 16:27:03 +00:00
helmutm
a689fb09bb work in progress: process upload of resources from loops.agent via HTTP PUT
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1954 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-23 13:28:15 +00:00
scrat
c3ffee3437 core.py
*agent now creates an empty temporary directory in
 which all jobs should create their jobdirectories

ui/web.py
* outlook crawler has changed, adapted ui methods
  accordingly to access OutlookResource objects
  instead of email.MIME lists
* using agent object as an attribute in the
  AgentHome class which is now passed through when
  necessary
* changed form for creating OutlookCrawlJobs to provide
  possibility to select whether inbox, subfolders or
  both foldertypes should be crawled and to specify
  a regular expression for subfolder selection
  todo: add scheduler options
* changed the way how jobdetails are displayed
* changed display of crawling ressources:
  now it is also possible to display the job folders
  and enter them to view the mail objects

* added first sketch of a filesystem crawler form,
  without functionality at the moment

known bugs: currently having problems with character encodings

git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1950 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-22 13:57:22 +00:00
helmutm
993356b8ae work in progress: http put tranport, + server-side integrator put handler
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1940 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-20 17:03:09 +00:00
helmutm
d564ff0de1 provide first simple logging implementation
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1935 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-19 14:44:05 +00:00
helmutm
381ee37285 work in progress: provide logging
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1918 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-14 09:13:19 +00:00
helmutm
c6980e85c7 Job: + whenStarted, whenFinished callbacks, now with additional job argument; let Scheduler.schedule() return the real startTime (may be used as jobId)
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1917 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-14 08:31:01 +00:00
helmutm
ea8ea93528 Job: + whenStarted, whenFinished callbacks, now with additional job argument; let Scheduler.schedule() return the real startTime (may be used as jobId)
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1916 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-14 08:25:56 +00:00
helmutm
8469575076 Job: + whenStarted, whenFinished callbacks, now with additional job argument; let Scheduler.schedule() return the real startTime (may be used as jobId)
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1915 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-14 08:25:13 +00:00
helmutm
2ac3c63888 Job: + whenStarted, whenFinished callbacks, now with additional job argument; let Scheduler.schedule() return the real startTime (may be used as jobId)
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1914 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-14 08:24:49 +00:00
helmutm
5348071d34 Job: + whenStarted, whenFinished callbacks; remove transport/httpput.py
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1913 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-14 07:32:38 +00:00
helmutm
f3002188d5 added simple server and client scripts for testing the HTTP transport; transport now basically working
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1905 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-10 15:46:14 +00:00
helmutm
2f81551c2a make interfaces, README, transport conform to each other
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1904 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-10 11:57:21 +00:00
helmutm
e140e0eccc minor improvements on scheduling
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1903 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-10 11:23:07 +00:00
helmutm
de87f1ff91 schedule: put successor jobs in queue instead of just 'run'ning them
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1902 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-10 10:19:18 +00:00
helmutm
f4449162a1 extend base.Transporter class to full-blown HTTP transporter, thus eliminating the httpput module
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1901 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-10 09:55:45 +00:00
helmutm
e7928f1e32 added docstring and comments to transport.base
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1899 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-10 07:06:35 +00:00
helmutm
f2e5ba51b9 move metadata into Resource class; more on httpput transport
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1897 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-09 17:51:17 +00:00
helmutm
db31c2d252 work in progress: filesystem crawler - added basic metadata handling
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1893 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-09 14:55:07 +00:00
helmutm
913054b697 work in progress: filesystem crawler
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1891 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-09 14:30:14 +00:00
scrat
874d96c94b implemented first version of outlook.py for MailCrawling
added configuration management for ui using agent.config

folder mails is a proposal how to store mails (contains some samples)

git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1887 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-08 17:18:44 +00:00
tschmid
740aeca367 first check in
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1864 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-02 13:42:49 +00:00
scrat
ba37f85b0d small update. added a few comments on the classes to be more compliant with PEP 257
work in progress: reading and storing ini-settings in an xml file.

git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1863 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-01 22:23:47 +00:00
helmutm
77e035efbd provide Agent.scheduleJobsFromConfig() as part of the start-up procedure; work in progress: filesystem crawler
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1862 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-01 16:25:28 +00:00
helmutm
b9ba07ad95 provide Agent.scheduleJobsFromConfig() as part of the start-up procedure; work in progress: filesystem crawler
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1861 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-01 16:15:29 +00:00
helmutm
5f97f29bbb some minor corrections
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1860 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-01 13:13:02 +00:00
helmutm
100730cdbd set up Configurator stuff
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1859 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-01 13:11:27 +00:00
helmutm
7ea411b923 set up Configurator stuff
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1858 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-08-01 13:05:27 +00:00
scrat
56ae346777 git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1842 fd906abe-77d9-0310-91a1-e0d9ade77398 2007-07-26 14:32:19 +00:00
scrat
e53124a7cb 1.) changed source code in order to comply with the Python Style Guide (PEP-8, Version 56036), with exception of method names which are in mixedCase style at the moment.
2.) pages are now being built using fragments:
<content page (e.g. agent.html)>
  |- header.html
  |- top.html
  |- navigation.html
  |- footer.html

3.) the job list is now implemented as a table, using hyperlinks to select a job

4.) hovering over a table row now displays a yellow
bar that simplifies navigation inside the table 
  

git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1837 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-07-21 11:59:38 +00:00
helmutm
0366bd8c81 some minor improvements of top part and menu
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1830 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-07-16 12:55:45 +00:00
helmutm
169ddf5aae some moving around and renaming of templates and static resources
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1829 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-07-16 12:25:48 +00:00
scrat
22b4b2b2f9 git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1823 fd906abe-77d9-0310-91a1-e0d9ade77398 2007-07-11 21:07:54 +00:00
helmutm
c8b3e250d7 provide a base class for crawling jobs
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1804 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-06-24 08:37:55 +00:00
helmutm
e05e3bd6e4 set up dummy crawler and transport for testing; implement crawl-transfer sequence via job scheduler
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1801 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-06-22 16:16:05 +00:00
helmutm
621efb6081 set up dummy crawler and transport for testing; implement crawl-transfer sequence via job scheduler
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1800 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-06-22 15:15:25 +00:00
helmutm
271b0da1c2 Work in progress: set up basic agent functionality (with unit tests...)
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1784 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-06-09 16:47:26 +00:00
helmutm
d66bd7591c Work in progress: set up basic agent functionality (with unit tests...)
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1783 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-06-09 15:42:11 +00:00
helmutm
ad281796ea work in progress: loops.agent specification
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1780 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-06-08 17:13:32 +00:00
helmutm
8616289e2c created new sub-package loops.agent
git-svn-id: svn://svn.cy55.de/Zope3/src/loops/trunk@1777 fd906abe-77d9-0310-91a1-e0d9ade77398
2007-06-07 16:49:03 +00:00