initial policy queue implementation in process_upload

Signed-off-by: Mark Hymers <mhy@debian.org>

fix up existing changes file handling

Signed-off-by: Mark Hymers <mhy@debian.org>

rename known_changes

Signed-off-by: Mark Hymers <mhy@debian.org>

Merge commit 'ftpmaster/master'

Conflicts:
daklib/dbconn.py

Signed-off-by: Mark Hymers <mhy@debian.org>

Try to sanitise changes and queue handling

Signed-off-by: Mark Hymers <mhy@debian.org>

Stop talking about old and even older and yet older versions / vcs information

Signed-off-by: Joerg Jaspert <joerg@debian.org>

remove some very old files

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Merge commit 'djpig/djpig' into merge

* commit 'djpig/djpig':
  clean_queues: Log which queue we remove from

Signed-off-by: Joerg Jaspert <joerg@debian.org>

clean_queues: Log which queue we remove from

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

Merge commit 'djpig/djpig' into merge

* commit 'djpig/djpig':
  Fix error in SQLA mapper setup

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Fix error in SQLA mapper setup

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

remove manpages, not much sense to have them, noone uses them

Signed-off-by: Joerg Jaspert <joerg@debian.org>

remove a manpage. closes: 540170

remove a manpage

Signed-off-by: Joerg Jaspert <joerg@debian.org>

rm

another rm.
closes: #540170

Signed-off-by: Joerg Jaspert <joerg@debian.org>

readme

remove a pretty old documentation

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Merge commit 'djpig/process-upload'

Also remove p-a and p-unchecked to avoid confusion

Conflicts:
daklib/dbconn.py
daklib/queue.py

Signed-off-by: Mark Hymers <mhy@debian.org>

check_files: check changes against known_changes

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

Various fixes

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

changes: fix known_changes handling of parsed changes files

Some fields in the changes file are stored as dicts, so handle
them correctly here where we only want the string.

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

changes: Remove .dak file handling

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

don't delete files in queue_files

Signed-off-by: Mark Hymers <mhy@debian.org>

check_dsc_against_db: fix a corner-case in .orig. handling

If the .orig.tar was contained in the .changes file but already
present in the pool, we did delete it from the file list, but
did not record the files id in the desc file list.

In the old code this did not cause any errors since process-accepted
called check_dsc_against_db with the file list loaded from the .dak
file which was already cleansed of the .orig. So it took the other
code branch (.orig. present in the pool but not in changes) which
did record the files id.

Now we only call check_dsc_against_db once in process-upload so
we need to record the files id in this case, too.

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

process-upload: try to use the same session all over the code

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

Fix various errors caused by moving stuff around

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

process-upload: make sure we clean up after ourself

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

changes: Use @session_wrapper

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

Merge commit 'mhy/master' into merge

* commit 'mhy/master':
  add changes and queue handling

Signed-off-by: Joerg Jaspert <joerg@debian.org>

add changes and queue handling

Signed-off-by: Mark Hymers <mhy@debian.org>

sig verify

dont barf on policy_url in a sig, even if the usge of that is pretty
pointless for things uploaded to the archive.

Signed-off-by: Joerg Jaspert <joerg@debian.org>

queue: Add missing SQLA import

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

Fix typo in function name

check_dm_source_upload -> check_dm_upload

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

Merge process-accepted's install into Upload.install()

queue build support is still disabled since we will modify that
significantly.

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

Upload: remove cruft

* Remove unused reprocess member
* Remove CopyDotDak support

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

Move helper functions for database insertion to dbconn

Copy
add_poolfile
add_dsc_to_db
add_deb_to_db
from process-accepted to dbconn so that we can use them
from the new process-upload.

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

Merge commit 'private/master' into process-upload

Merge commit 'stew/knownchanges' into merge

* commit 'stew/knownchanges':
  split read and write locks

Signed-off-by: Joerg Jaspert <joerg@debian.org>

split read and write locks

Signed-off-by: Mike O'Connor <stew@vireo.org>

Merge commit 'lamby/master' into merge

* commit 'lamby/master': (23 commits)
  'as' is a reserved word in Python 2.6.
  Don't shadow 'file' builtin in daklib.queue.
  Use 4 spaces for indentation.
  Correct code to match documentation of Binary.check_utf8_package
  Remove unused 'time' import.
  Correct isinstance call; DictType is not an actual type.
  dak's "Dict" is a synonym of the 'dict' builtin
  Use foo.iteritems() to avoid reentrancy with foo[k].
  Don't shadow 'map' builtin in daklib.utils.TemplateSubst
  Update comment about our monkeypatching of commands.getstatusoutput.
  Remove duplicated 'commands' import.
  Don't use deprecated string module.
  Remove unused imports from daklib.queue.
  Remove shadowing builtins in daklib.queue
  Remove daklib's now-unused extension functionality.
  Remove shadowing builtins in daklib.dbconn.
  Don't shadow 'dir' builtin in daklib.utils.get_changes_files
  We don't use re_is_orig_source in daklib.utils anymore.
  Don't shadow "dir" builtin.
  Fix uid references in DM upload error codepaths.
  ...

Signed-off-by: Joerg Jaspert <joerg@debian.org>

'as' is a reserved word in Python 2.6.

Signed-off-by: Chris Lamb <lamby@debian.org>

Don't shadow 'file' builtin in daklib.queue.

Signed-off-by: Chris Lamb <lamby@debian.org>

Use 4 spaces for indentation.

Signed-off-by: Chris Lamb <lamby@debian.org>

Correct code to match documentation of Binary.check_utf8_package

Signed-off-by: Chris Lamb <lamby@debian.org>

Remove unused 'time' import.

Signed-off-by: Chris Lamb <lamby@debian.org>

Correct isinstance call; DictType is not an actual type.

Signed-off-by: Chris Lamb <lamby@debian.org>

dak's "Dict" is a synonym of the 'dict' builtin

Signed-off-by: Chris Lamb <lamby@debian.org>

Use foo.iteritems() to avoid reentrancy with foo[k].

Signed-off-by: Chris Lamb <lamby@debian.org>

Don't shadow 'map' builtin in daklib.utils.TemplateSubst

Signed-off-by: Chris Lamb <lamby@debian.org>

Update comment about our monkeypatching of commands.getstatusoutput.

Signed-off-by: Chris Lamb <lamby@debian.org>

Remove duplicated 'commands' import.

Signed-off-by: Chris Lamb <lamby@debian.org>

Don't use deprecated string module.

Signed-off-by: Chris Lamb <lamby@debian.org>

Remove unused imports from daklib.queue.

Signed-off-by: Chris Lamb <lamby@debian.org>

Remove shadowing builtins in daklib.queue

Remove daklib's now-unused extension functionality.

Was only used for ACL-like purposes which was re-implemented.

Signed-off-by: Chris Lamb <lamby@debian.org>

Remove shadowing builtins in daklib.dbconn.

Signed-off-by: Chris Lamb <lamby@debian.org>

Don't shadow 'dir' builtin in daklib.utils.get_changes_files

Signed-off-by: Chris Lamb <lamby@debian.org>

We don't use re_is_orig_source in daklib.utils anymore.

Signed-off-by: Chris Lamb <lamby@debian.org>

Don't shadow "dir" builtin.

Signed-off-by: Chris Lamb <lamby@debian.org>

Fix uid references in DM upload error codepaths.

Signed-off-by: Chris Lamb <lamby@debian.org>

Fix component references in upload component error codepaths.

Signed-off-by: Chris Lamb <lamby@debian.org>

Fix handling of invalid Maintainer field.

Signed-off-by: Chris Lamb <lamby@debian.org>

Merge commit 'stew/knownchanges' into merge

* commit 'stew/knownchanges':
  try to get rid of deadlock

Signed-off-by: Joerg Jaspert <joerg@debian.org>

process-upload: import action() from process-unchecked

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

try to get rid of deadlock

Signed-off-by: Mike O'Connor <stew@vireo.org>

sort out type problem

Signed-off-by: Mark Hymers <mhy@debian.org>

Merge commit 'stew/knownchanges' into merge

* commit 'stew/knownchanges':
  towpdown import_known_changes

Signed-off-by: Joerg Jaspert <joerg@debian.org>

towpdown import_known_changes

Signed-off-by: Mike O'Connor <stew@vireo.org>

queue_install: Adapt to new code organisation

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

Merge commit 'mhy/suitesql' into merge

* commit 'mhy/suitesql':
  never change things at the last minute...

Signed-off-by: Joerg Jaspert <joerg@debian.org>

never change things at the last minute...

Signed-off-by: Mark Hymers <mhy@debian.org>

Copy parts of process-unchecked to daklib.queue_install

To not bloat the new process-upload script unnecessarily

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

Merge commit 'mhy/suitesql' into merge

* commit 'mhy/suitesql':
  fix up policy_queue support in the ORM and drop old column
  add support for policy queues to the database

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Merge commit 'ftpmaster/master' into suitesql

fix up policy_queue support in the ORM and drop old column

Signed-off-by: Mark Hymers <mhy@debian.org>

Merge commit 'stew/knownchanges' into merge

* commit 'stew/knownchanges':
  I                                         LOVE                                           WHITESPACE
  i was trying to interrupt this with the keyboards and failing
  get rid of log msgs
  import known_changes with correct name.  catch keybord exception

Signed-off-by: Joerg Jaspert <joerg@debian.org>

I                                         LOVE                                           WHITESPACE

add support for policy queues to the database

Signed-off-by: Mark Hymers <mhy@debian.org>

i was trying to interrupt this with the keyboards and failing

Add an inline signed release file

Signed-off-by: Joerg Jaspert <joerg@debian.org>

process-upload: clean up process_it()

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

epydoc header

Signed-off-by: Joerg Jaspert <joerg@debian.org>

process-upload: import process_it() from process-unchecked

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

process-upload: reorganise option parsing

Give more helpful error messages and log where we did get
the changes files from.

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

Merge commit 'public/knownchanges' into knownchanges

get rid of log msgs

import known_changes with correct name.  catch keybord exception

Signed-off-by: Mike O'Connor <stew@vireo.org>

Merge commit 'lamby/master' into merge

* commit 'lamby/master':
  Remove duplicate return statement.
  Add missing Config initialiser.
  Fix do_anaias in cruft-report.
  Add missing import in contents
  Add missing configuration initialiser.
  Fix check_indices_files_exist in check-archive.
  Fix local variable in check-archive/check_override
  Fix check_override in check-archive.
  Don't shadow built-in 'file'
  Consistently use 4-spaces in add_user.py
  Don't mix tabs and spaces in add_user.py

Signed-off-by: Joerg Jaspert <joerg@debian.org>

Remove duplicate return statement.

Signed-off-by: Chris Lamb <lamby@debian.org>

Add missing Config initialiser.

Signed-off-by: Chris Lamb <lamby@debian.org>

Fix do_anaias in cruft-report.

Signed-off-by: Chris Lamb <lamby@debian.org>

Add missing import in contents

Signed-off-by: Chris Lamb <lamby@debian.org>

Add missing configuration initialiser.

Signed-off-by: Chris Lamb <lamby@debian.org>

Fix check_indices_files_exist in check-archive.

Signed-off-by: Chris Lamb <lamby@debian.org>

Fix local variable in check-archive/check_override

Signed-off-by: Chris Lamb <lamby@debian.org>

Fix check_override in check-archive.

Signed-off-by: Chris Lamb <lamby@debian.org>

process-upload: Change logging behaviour for --no-action

Log to stderr instead if not at all.

Signed-off-by: Frank Lichtenheld <djpig@debian.org>

Don't shadow built-in 'file'

Signed-off-by: Chris Lamb <lamby@debian.org>

Consistently use 4-spaces in add_user.py

Signed-off-by: Chris Lamb <lamby@debian.org>

Merge commit 'stew/knownchanges' into merge

* commit 'stew/knownchanges':
  now actuall working

Signed-off-by: Joerg Jaspert <joerg@debian.org>

merge from flotow

Signed-off-by: Mike O'Connor <stew@vireo.org>

Merge commit 'stew/knownchanges' into merge

* commit 'stew/knownchanges':
  importing old changes files into knwon_changes with a separeate script, now allowing some fields to be 'missing'

Signed-off-by: Joerg Jaspert <joerg@debian.org>