cco/cybertools
3
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
685 commits 5 branches 0 tags 6.5 MiB
Commit graph

79 commits

Author SHA1 Message Date
helmutm
c0ce542b9c work in progress: 'agent.talk' HTTP communication 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@3276 fd906abe-77d9-0310-91a1-e0d9ade77398
 2009-03-15 09:38:43 +00:00
helmutm
f627a50942 remove unused imports; add comment for future change: use decorators for component registration 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2984 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-11-14 08:30:09 +00:00
helmutm
3baf1fabb5 work in progress: talk package for generic data communication tasks 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2925 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-10-19 17:46:10 +00:00
helmutm
9a6d66dfea work in progress: talk package for generic data communication tasks 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2924 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-10-19 10:10:50 +00:00
helmutm
e0503fea5b add 'talk' package providing a common communication framework 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2923 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-10-17 20:46:28 +00:00
helmutm
c751b6116c start setting up some more controller classes 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2919 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-10-17 09:36:33 +00:00
helmutm
64ccc2cc94 remote transport working via test script 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2769 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-07-24 05:54:53 +00:00
scrat
bfd6191683 modified transport/file/sftp.py to establish a connection to a server and get file upload running. 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2768 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-07-21 19:57:38 +00:00
scrat
051565a155 adaptions to get main_transport working 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2763 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-07-19 09:10:44 +00:00
helmutm
596222d42b make transporter doctest run with fake sftp server module 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2760 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-07-14 07:00:57 +00:00
scrat
c367f55637 added dummy sftp.py for testing purposes 
remote.py: now the file on the remote server gets the basename of the local file
outlook.py: added utf-8 encoding for the mail content to avoid problems with special characters

git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2759 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-07-13 09:06:28 +00:00
scrat
80ff9b8403 Updated outlook.py to support writing also the mail text data to a temporary file with mkstemp. Also changed some details in saving the attachments which has been wrong up to now. 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2756 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-07-12 13:45:47 +00:00
scrat
411c130300 intermediate check-in. Changes in remote.py and transporter.cfg added sftpapi 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2735 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-07-03 21:56:29 +00:00
helmutm
cea87a8225 work in progress: resource transfer via sftp, + testing code 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2733 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-07-02 15:51:58 +00:00
scrat
f0373140fa main_transport.py should now have same functionality as transporter doctest. 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2732 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-07-01 20:42:08 +00:00
helmutm
e76f640529 make transporter run with dummy XML-RPC API 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2722 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-06-25 15:48:12 +00:00
helmutm
9db11e8486 make transporter running with dummy XML-RPC API 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2721 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-06-25 15:24:17 +00:00
scrat
9570ed459f changed rpcapi.py and rpcserver to support the remoteCall call schema properly (was first implemented wrong with the server having the callRemote method, which actually should be part of the xmlrpc.Proxy). 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2720 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-06-23 20:24:58 +00:00
scrat
9a70a8b307 forgot to check in the doctest file transporter.txt 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2719 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-06-22 16:21:20 +00:00
scrat
af16d445c6 further work on the transporter integration.added functionality for testing a simulated rpcserver similar to what has been done for outlook crawler. 
until now unfortunately using the testcase for the transporter does not work, because the params handed over in the doctest do not arrive at the Transporter object. This is why the doctest is not yet registered in cybertools.agent/test.py

git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2718 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-06-22 15:58:38 +00:00
scrat
5a48213560 intermediate check-in. moved rpcserver.py to testing, but yet only a part of the requested changes have been made there. 
rpcclient functionality has been integrated into /transport/remote.py
The transporter class is now using its own config-file (as a first idea).

git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2717 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-06-20 22:18:35 +00:00
scrat
5a1e67fe5c Added rpcclient.py in /agent/transport which is instantiated by Transporter in /agent/transport/remote.py 
Added rpcserver.py in /agent/control which is intended to
be listening on connections and hands over metadata and resource objects to a controller.

git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2711 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-06-13 21:35:42 +00:00
helmutm
dc970aa2f7 added modules for transport and remote controller 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2666 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-06-04 15:47:35 +00:00
helmutm
615e8c68bf added modules for setting up real-life test runs 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2665 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-06-04 15:47:04 +00:00
helmutm
6e0ef6fd03 work in progress: SFTP transfer 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2664 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-06-04 15:45:55 +00:00
scrat
a9b8de7b21 now the doctest *really* works with the winapi.py. 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2658 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-31 13:48:47 +00:00
scrat
f1967e38eb some smaller changes to make the attachment examples work 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2657 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-31 13:32:49 +00:00
helmutm
757d47ba12 work in progress: resource/file transfer with SFTP 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2653 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-31 08:58:13 +00:00
helmutm
d319203a4f work in progress: transport, esp filetransfer with sftp 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2650 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-30 10:18:47 +00:00
helmutm
9754f0e22d set up filetransfer module 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2649 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-30 09:30:06 +00:00
helmutm
2909cde81d set up filetransfer module 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2648 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-30 09:29:57 +00:00
scrat
228b7e9077 git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2632 fd906abe-77d9-0310-91a1-e0d9ade77398 2008-05-25 17:44:57 +00:00
scrat
8e24cbc7c5 added Attachments and Attachment classes to winapi.py to get a more comprehensive doctest. In course of this change some small glitches have been found in outlook.py and mail.py, which concerned adressing of the Attachment items in outlook.py (createResource) and mail.py where the createMetadata Method now has **kw arguments for adding the filePath as a Metadata in case the mail has an attachment. 
The outlook.txt doctest has been changed to adopt the new test.
winapi now contains only one extended example but it will get two more as soon as possible.

git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2631 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-25 17:02:00 +00:00
helmutm
70f92e90b0 work in progress: extend and improve commandline controller 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2613 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-23 10:19:25 +00:00
helmutm
740fc05308 extend cmdline controller to handle simple agent and job specifications 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2612 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-21 11:52:28 +00:00
scrat
5bfe771ab9 moved codepages.py and the handling of outlook dialoges to system/windows/ 
writing outlook attachments to disk with mkstemp (NamedTemporaryFile would delete file after closing the handle)

git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2602 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-17 10:31:02 +00:00
scrat
62330d395f Added id to codepages.py 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2590 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-10 15:43:36 +00:00
scrat
52d6d9348c replaced createMIMEMail with an overwritten version of createResource and also moved the collection of the Metadata to the method assembleMetadata. 
Added a new module inagent/util which contains a dictionary with all more or less often used codepages and their representation in an Outlook Mail object.jsUntil now, the attachments are only represented by thei filenames as a list named subResources.

git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2589 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-10 15:39:25 +00:00
helmutm
ac5013a026 more on resources: extend interface and base class 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2585 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-09 07:47:39 +00:00
helmutm
8582252967 work in progress: structuring of resources and metadata 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2580 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-08 10:12:57 +00:00
scrat
167e914055 changed outlook.py: now much more data from the outlook mails is available. Now we also can access the date the mail was sent as well when it has been received. Also data about the attachements is now available (if desired). 
Minor change to winapi was necessary in order to support the doctests with the changed outlook api.
_prop_map_get now returns a dictionary instead of a tuple.

git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2577 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-04 21:26:57 +00:00
helmutm
4c4ada47da add basic filesystem crawler 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2570 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-05-01 18:59:06 +00:00
scrat
3acc628b80 Changed createEmailMime and loadMailsFromFolder to include now all available elements (when no key is specified) and also inform the user if a specified key does not exist or has an invalid attribute type. 
So far this Outlook Crawler works with Outlook2007 the same way like with Outlook2000 (which unfortunately also means: no date to be retrieved so far)

git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2548 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-04-26 14:38:55 +00:00
helmutm
9c92fd07f3 work in progress: object actions, stateful resources: classification quality 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2539 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-04-23 08:42:58 +00:00
helmutm
9826f31cc2 move com_error to system.windows.api 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2536 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-04-23 08:36:53 +00:00
scrat
acc93c09b5 Changed bad return type self.result in outllok.py back to None 
Added import for com_error type in outlook.py.

added main_outlook.py in /testing to run tests against Outlook2000. Also added outlook.cfg in /testing which has the configuration data for main_outlook.py

Removed outlook_real.txt and doctests line from tests.py

git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2535 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-04-22 21:26:14 +00:00
scrat
bd1c522b20 added a doctest in tests.py for testing access to the Outlook API. Minor changes in outlook.py in order to avoid Outlook COM Exception upon call on certain MailItem Attributes (Bug in Outlook API?). 
outlook.py: loadMailsFromFolder now returns self.result instead of yield None. Otherwise nothing would be returned.
Added doctest outlook_real.txt which uses the Outlook API.

git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2534 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-04-21 15:42:58 +00:00
helmutm
1a0084e46f work in progress: outlook crawler: make dummy implementation work 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2528 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-04-16 16:01:39 +00:00
helmutm
9f7afd166f add **kw to enterJob() so that job parameters may be supplied 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2524 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-04-12 17:26:36 +00:00
helmutm
97699eede7 make crawlFolders() a generator by adding yield statements 
git-svn-id: svn://svn.cy55.de/Zope3/src/cybertools/trunk@2523 fd906abe-77d9-0310-91a1-e0d9ade77398
 2008-04-12 17:17:50 +00:00