]>
err.no Git - dak/log
Eric Cooper [Fri, 13 May 2011 00:07:01 +0000 (20:07 -0400)]
don't include filename or timestamp in gzipped files
(optional: also compress at level 9)
Omitting the timestamp makes it possible to reconstruct an exact copy of the .gz
file given only the uncompressed contents. The approx caching proxy relies on this
to apply pdiffs and generate compressed index files that correctly match their checksums.
Signed-off-by: Eric Cooper <ecc@cmu.edu>
Joerg Jaspert [Wed, 11 May 2011 21:40:08 +0000 (23:40 +0200)]
Merge remote branch 'ansgar/p-s-from-db' into merge
* ansgar/p-s-from-db:
Add missing import statements
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Ansgar Burchardt [Wed, 11 May 2011 21:31:18 +0000 (21:31 +0000)]
Add missing import statements
Joerg Jaspert [Wed, 11 May 2011 18:10:32 +0000 (20:10 +0200)]
also import Suite
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Wed, 11 May 2011 17:11:23 +0000 (19:11 +0200)]
Merge remote branch 'ansgar/p-s-from-db' into merge
* ansgar/p-s-from-db:
gps2: Initialize process pool before connecting to database
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Ansgar Burchardt [Wed, 11 May 2011 14:32:39 +0000 (14:32 +0000)]
gps2: Initialize process pool before connecting to database
Joerg Jaspert [Mon, 9 May 2011 21:30:01 +0000 (23:30 +0200)]
import_dataset
we also dont need gps called in here
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Mon, 9 May 2011 21:28:19 +0000 (23:28 +0200)]
kill do_dists
no need to write packages files in unchecked anymore. gps2 doesnt have
braindead berkeley db shit to update
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sun, 8 May 2011 20:51:21 +0000 (22:51 +0200)]
s/base/basen/
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sun, 8 May 2011 20:31:54 +0000 (22:31 +0200)]
s/foo/base
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sun, 8 May 2011 15:41:15 +0000 (17:41 +0200)]
pdiff shit
add a function to fill up a git tree for the possible replacement of the shit script thats currently creating pdiff files
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sun, 8 May 2011 12:28:26 +0000 (14:28 +0200)]
check mirror
we check the mirror before we push anything. We currently parse
the SHA1 field, checking for existence, size and checksum.
this means we should catch the HASH SUM MISMATCH crap.
of course this means the ones using ftp-master.d.o directly still lose, but we cant help
that.
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sun, 8 May 2011 10:26:07 +0000 (12:26 +0200)]
import a bit from from processpool
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sat, 7 May 2011 21:28:54 +0000 (23:28 +0200)]
no longer run a-f cleanup in weekly
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sat, 7 May 2011 18:37:38 +0000 (20:37 +0200)]
dont output tag lines from metadata table, only external overrides
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sat, 7 May 2011 15:27:00 +0000 (17:27 +0200)]
use gps2 in unchecked. also disable gen-filelists in dinstall
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sat, 7 May 2011 12:52:11 +0000 (14:52 +0200)]
also do it for imports
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sat, 7 May 2011 12:51:02 +0000 (14:51 +0200)]
switch of a-f
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sat, 7 May 2011 12:39:34 +0000 (14:39 +0200)]
Merge remote branch 'mhy/multiproc' into merge
* mhy/multiproc:
Get syntax right
Deal with args being a tuple
Add backwards compatibility code
Make daklog be a Singleton
Bugfixes for usage of DakProcessPool API
remove unused variable
Fix variable name
Fix function name
Fix up pool usage
Enhance process pool implementation
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Mark Hymers [Sat, 7 May 2011 12:35:26 +0000 (13:35 +0100)]
Merge remote branch 'ftpmaster/master' into multiproc
Conflicts:
dak/generate_packages_sources2.py
Signed-off-by: Mark Hymers <mhy@debian.org>
Joerg Jaspert [Fri, 6 May 2011 21:14:37 +0000 (23:14 +0200)]
kick out useless print stuff that only annoys in logs
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sun, 1 May 2011 21:51:58 +0000 (23:51 +0200)]
Merge remote branch 'ansgar/p-s-from-db' into merge
* ansgar/p-s-from-db:
do not generate binary-source/Packages
look for already existing files in build queues
fix typo in email address
sort Packages by source name first
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Ansgar Burchardt [Sun, 1 May 2011 18:54:05 +0000 (18:54 +0000)]
do not generate binary-source/Packages
Ansgar Burchardt [Thu, 28 Apr 2011 22:57:55 +0000 (22:57 +0000)]
look for already existing files in build queues
Ansgar Burchardt [Thu, 28 Apr 2011 19:38:38 +0000 (19:38 +0000)]
fix typo in email address
Ansgar Burchardt [Thu, 28 Apr 2011 17:35:14 +0000 (17:35 +0000)]
sort Packages by source name first
Mark Hymers [Wed, 20 Apr 2011 20:11:48 +0000 (21:11 +0100)]
Merge remote branch 'ftpmaster/master' into multiproc
Torsten Werner [Sun, 17 Apr 2011 21:31:33 +0000 (23:31 +0200)]
cron.unchecked: call generate-filelist with arguments.
Signed-off-by: Torsten Werner <twerner@debian.org>
Torsten Werner [Tue, 12 Apr 2011 19:08:34 +0000 (21:08 +0200)]
Fix exception handling in process-new.
closes: #620361
Signed-off-by: Torsten Werner <twerner@debian.org>
Mark Hymers [Sun, 10 Apr 2011 19:29:54 +0000 (20:29 +0100)]
Fall back to Maintainer if Changed-By missing
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Sat, 9 Apr 2011 08:42:22 +0000 (09:42 +0100)]
Merge remote branch 'ftpmaster/master' into multiproc
Conflicts:
dak/show_new.py
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 8 Apr 2011 20:31:52 +0000 (21:31 +0100)]
Merge remote branch 'ansgar/p-s-from-db' into merge
Signed-off-by: Mark Hymers <mhy@debian.org>
Ansgar Burchardt [Fri, 8 Apr 2011 19:31:26 +0000 (21:31 +0200)]
Merge remote-tracking branch 'origin/master' into p-s-from-db
Torsten Werner [Wed, 6 Apr 2011 19:17:13 +0000 (21:17 +0200)]
Fix function add_dsc_to_db().
Signed-off-by: Torsten Werner <twerner@debian.org>
Torsten Werner [Wed, 6 Apr 2011 18:22:40 +0000 (18:22 +0000)]
Update metadata for test DB.
Signed-off-by: Torsten Werner <twerner@debian.org>
Torsten Werner [Sun, 3 Apr 2011 09:14:13 +0000 (11:14 +0200)]
Do not sync any lock files.
Signed-off-by: Torsten Werner <twerner@debian.org>
Torsten Werner [Sat, 2 Apr 2011 08:38:43 +0000 (10:38 +0200)]
Install default SIGPIPE handler before calling dpkg-deb.
Signed-off-by: Torsten Werner <twerner@debian.org>
Mark Hymers [Fri, 1 Apr 2011 16:17:19 +0000 (16:17 +0000)]
Don't remove files we previously generated
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 16:03:11 +0000 (16:03 +0000)]
Short circuit already processed packages much more quickly
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 15:52:42 +0000 (15:52 +0000)]
Pass session
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 15:51:27 +0000 (15:51 +0000)]
Don't end up with multiple database sessions in check_sig call
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 14:54:14 +0000 (14:54 +0000)]
Linearise show_new for now
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 12:56:08 +0000 (12:56 +0000)]
Map squeeze-updates and stable-updates
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 12:08:47 +0000 (12:08 +0000)]
Limit show-new to one process for now
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 11:38:57 +0000 (11:38 +0000)]
Re-enable queue_rss after deleting the old pickle file
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 11:34:59 +0000 (11:34 +0000)]
use new debian module name
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 11:31:51 +0000 (11:31 +0000)]
Python behaves differently if you're redirecting to a file or not...
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 11:27:19 +0000 (11:27 +0000)]
Encode using utf-8 and hope for the best
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 11:22:32 +0000 (11:22 +0000)]
dak graph seems ok too
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 11:21:09 +0000 (11:21 +0000)]
Re-enable show-new, but don't kill cron.hourly if it dies
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 11:06:37 +0000 (11:06 +0000)]
Fix typo
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 11:06:20 +0000 (11:06 +0000)]
temporary hack to fix squeeze-updates / stable-updates suite name
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 11:02:23 +0000 (11:02 +0000)]
Comment out some things in cron.hourly which are broken
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Fri, 1 Apr 2011 11:01:27 +0000 (11:01 +0000)]
Merge remote branch 'ftpmaster/master'
Torsten Werner [Fri, 1 Apr 2011 05:54:36 +0000 (07:54 +0200)]
Make cron.daily shell script more robust.
... and reindent it.
Signed-off-by: Torsten Werner <twerner@debian.org>
Torsten Werner [Thu, 31 Mar 2011 17:23:21 +0000 (19:23 +0200)]
Excluding more directories from syncing.
Signed-off-by: Torsten Werner <twerner@debian.org>
Ansgar Burchardt [Thu, 31 Mar 2011 10:52:34 +0000 (12:52 +0200)]
copy external overrides from unstable to testing
Signed-off-by: Ansgar Burchardt <ansgar@debian.org>
Ansgar Burchardt [Thu, 31 Mar 2011 10:41:34 +0000 (12:41 +0200)]
Merge remote-tracking branch 'origin/master' into p-s-from-db
Joerg Jaspert [Tue, 29 Mar 2011 20:47:28 +0000 (22:47 +0200)]
sick
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Tue, 29 Mar 2011 20:43:36 +0000 (22:43 +0200)]
function pg_timestamp
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Tue, 29 Mar 2011 20:34:37 +0000 (22:34 +0200)]
updates
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Mark Hymers [Tue, 29 Mar 2011 20:10:03 +0000 (21:10 +0100)]
Get syntax right
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Tue, 29 Mar 2011 20:09:04 +0000 (21:09 +0100)]
Deal with args being a tuple
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Tue, 29 Mar 2011 20:07:56 +0000 (21:07 +0100)]
Add backwards compatibility code
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Tue, 29 Mar 2011 19:53:40 +0000 (20:53 +0100)]
Make daklog be a Singleton
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Tue, 29 Mar 2011 08:00:18 +0000 (08:00 +0000)]
Merge branch 'master', remote branch 'ftpmaster/master'
Joerg Jaspert [Tue, 29 Mar 2011 06:39:08 +0000 (08:39 +0200)]
off you are
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Mon, 28 Mar 2011 19:16:00 +0000 (21:16 +0200)]
moved ddaccess push into locks
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Mon, 28 Mar 2011 19:12:00 +0000 (21:12 +0200)]
no need for extra step
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Mark Hymers [Mon, 28 Mar 2011 18:33:46 +0000 (19:33 +0100)]
Bugfixes for usage of DakProcessPool API
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Mon, 28 Mar 2011 18:07:40 +0000 (19:07 +0100)]
remove unused variable
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Mon, 28 Mar 2011 00:39:37 +0000 (01:39 +0100)]
Fix variable name
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Mon, 28 Mar 2011 00:37:32 +0000 (01:37 +0100)]
Fix function name
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Mon, 28 Mar 2011 00:36:36 +0000 (01:36 +0100)]
Fix up pool usage
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Mon, 28 Mar 2011 00:12:39 +0000 (01:12 +0100)]
Enhance process pool implementation
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Sun, 27 Mar 2011 09:55:08 +0000 (10:55 +0100)]
Close log so we log program end
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Sun, 27 Mar 2011 09:45:34 +0000 (10:45 +0100)]
Fix up function call
Signed-off-by: Mark Hymers <mhy@debian.org>
Ansgar Burchardt [Sun, 27 Mar 2011 09:42:40 +0000 (09:42 +0000)]
Make external overrides specific for (suite, component)
Signed-off-by: Ansgar Burchardt <ansgar@debian.org>
Mark Hymers [Sun, 27 Mar 2011 09:37:17 +0000 (10:37 +0100)]
Tidy up logging
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Sun, 27 Mar 2011 09:35:24 +0000 (10:35 +0100)]
And the right arguments
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Sun, 27 Mar 2011 09:34:27 +0000 (10:34 +0100)]
Actually call the functions...
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Sun, 27 Mar 2011 09:33:27 +0000 (10:33 +0100)]
Our log function expects a single list argument
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Sun, 27 Mar 2011 09:28:14 +0000 (10:28 +0100)]
Run linearly until we can debug why the multiprocessing stuff hangs
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Sun, 27 Mar 2011 08:08:56 +0000 (09:08 +0100)]
Comment out results gathering to test for hang failure
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Sun, 27 Mar 2011 08:06:41 +0000 (09:06 +0100)]
Merge branch 'master' of ssh://ftp-master.debian.org/srv/ftp.debian.org/git/dak
Mark Hymers [Sun, 27 Mar 2011 08:06:35 +0000 (09:06 +0100)]
close logger
Signed-off-by: Mark Hymers <mhy@debian.org>
Joerg Jaspert [Sun, 27 Mar 2011 08:02:54 +0000 (10:02 +0200)]
Merge remote-tracking branch 'ansgar/p-s-from-db' into merge
* ansgar/p-s-from-db:
Add external-overrides to byhand scripts.
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Ansgar Burchardt [Sun, 27 Mar 2011 08:00:14 +0000 (10:00 +0200)]
Add external-overrides to byhand scripts.
Signed-off-by: Ansgar Burchardt <ansgar@debian.org>
Joerg Jaspert [Sun, 27 Mar 2011 07:54:26 +0000 (09:54 +0200)]
and one = is enough for the scripts
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sun, 27 Mar 2011 07:50:22 +0000 (09:50 +0200)]
holy fuck goddamn lunatics
whoever had the fuck broken stupid idea of making dash the default
/bin/sh should be shot. fucking stupid damn lunatics, go die you
suckers. or use windows. whatever. LEAVE THE WORLD SANE. stupid bitches.
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sun, 27 Mar 2011 07:42:32 +0000 (09:42 +0200)]
no deferred queue
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sun, 27 Mar 2011 07:31:10 +0000 (09:31 +0200)]
shutup
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Joerg Jaspert [Sat, 26 Mar 2011 22:55:41 +0000 (23:55 +0100)]
Merge remote-tracking branch 'ansgar/p-s-from-db' into merge
* ansgar/p-s-from-db:
generate-packages-sources2: respect overridesuite
process-upload: Add counter for rejected packages
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Ansgar Burchardt [Sat, 26 Mar 2011 22:49:17 +0000 (22:49 +0000)]
generate-packages-sources2: respect overridesuite
Signed-off-by: Ansgar Burchardt <ansgar@debian.org>
Ansgar Burchardt [Sat, 26 Mar 2011 22:26:55 +0000 (22:26 +0000)]
process-upload: Add counter for rejected packages
Signed-off-by: Ansgar Burchardt <ansgar@debian.org>
Joerg Jaspert [Sat, 26 Mar 2011 22:26:20 +0000 (23:26 +0100)]
also call dak gps2
Signed-off-by: Joerg Jaspert <joerg@debian.org>
Mark Hymers [Sat, 26 Mar 2011 22:12:38 +0000 (22:12 +0000)]
Add self. to rejects
Signed-off-by: Mark Hymers <mhy@debian.org>
Mark Hymers [Sat, 26 Mar 2011 22:12:02 +0000 (22:12 +0000)]
Merge branch 'master' of ssh://ftp-master.debian.org/srv/ftp.debian.org/git/dak
Mark Hymers [Sat, 26 Mar 2011 22:11:46 +0000 (22:11 +0000)]
Mark dsc as invalid if we find any reject reasons
Signed-off-by: Mark Hymers <mhy@debian.org>
Torsten Werner [Sat, 26 Mar 2011 22:10:33 +0000 (23:10 +0100)]
Use the newdists dir as temporary output dir for g-p-s2.
It should be changed back after more testing.
Signed-off-by: Torsten Werner <twerner@debian.org>