Re: wal-e package

Hi.

I have packaged wal-e, a tool for PostgreSQL backups and WAL shipping
to Swift, Azure & S3 blobs stores. I have it building for Ubuntu 14.04
and Ubuntu 14.10 in a Launchpad PPA:

https://launchpad.net/~stub/+archive/ubuntu/pgcharm/+packages
https://launchpad.net/~stub/+archive/ubuntu/pgcharm/+files/wal-e_0.7.1-0%7E14%7Edaily%7Eubuntu14.04.1.dsc
https://launchpad.net/~stub/+archive/ubuntu/pgcharm/+files/wal-e_0.7.1-0%7E14%7Edaily%7Eubuntu14.04.1_all.deb

It also requires the python-azure package from the same PPA:

https://launchpad.net/~stub/+archive/ubuntu/pgcharm/+files/python-azure_0.8.1-0%7E5%7Eubuntu14.04.1.dsc

Ubuntu 14.04 also requires a backport backports of python-swiftclient
2.1.0. I was unable to obtain backports of this to releases earlier
than Ubuntu 14.04.

Is this appropriate for apt.postgresql.org?

How to I go about getting it included in apt.postgresql.org?

I am not a Debian Developer.

--
Stuart Bishop <stuart(at)stuartbishop(dot)net>
http://www.stuartbishop.net/

Re: Stuart Bishop 2014-08-28 <CADmi=6MiYE2++Q47yPLr3apswtcqwRnY2=gQxxh6NCA56h--KQ(at)mail(dot)gmail(dot)com>
> Hi.
>
> I have packaged wal-e, a tool for PostgreSQL backups and WAL shipping
> to Swift, Azure & S3 blobs stores. I have it building for Ubuntu 14.04
> and Ubuntu 14.10 in a Launchpad PPA:
>
> https://launchpad.net/~stub/+archive/ubuntu/pgcharm/+packages
> https://launchpad.net/~stub/+archive/ubuntu/pgcharm/+files/wal-e_0.7.1-0%7E14%7Edaily%7Eubuntu14.04.1.dsc
> https://launchpad.net/~stub/+archive/ubuntu/pgcharm/+files/wal-e_0.7.1-0%7E14%7Edaily%7Eubuntu14.04.1_all.deb
>
> It also requires the python-azure package from the same PPA:
>
> https://launchpad.net/~stub/+archive/ubuntu/pgcharm/+files/python-azure_0.8.1-0%7E5%7Eubuntu14.04.1.dsc
>
> Ubuntu 14.04 also requires a backport backports of python-swiftclient
> 2.1.0. I was unable to obtain backports of this to releases earlier
> than Ubuntu 14.04.
>
> Is this appropriate for apt.postgresql.org?

It surely is.

> How to I go about getting it included in apt.postgresql.org?

At the moment, there's two mechanisms, building from some VCS repo
(git, svn, bzr), or pulling the source from Debian unstable. Is there
a VCS for the sources? (debian/ only is sufficient, the rest can come
from upstream tarballs)

In any case I prefer the package to also be in Debian, though that's
not a strict requirement.

> I am not a Debian Developer.

Would you be interested to maintain the package in Debian? I can
sponsor uploads.

Christoph
--
cb(at)df7cb(dot)de | http://www.df7cb.de/

On 28 August 2014 16:29, Christoph Berg <cb(at)df7cb(dot)de> wrote:
> Re: Stuart Bishop 2014-08-28 <CADmi=6MiYE2++Q47yPLr3apswtcqwRnY2=gQxxh6NCA56h--KQ(at)mail(dot)gmail(dot)com>
>> Hi.
>>
>> I have packaged wal-e, a tool for PostgreSQL backups and WAL shipping
>> to Swift, Azure & S3 blobs stores. I have it building for Ubuntu 14.04
>> and Ubuntu 14.10 in a Launchpad PPA:
>>
>> https://launchpad.net/~stub/+archive/ubuntu/pgcharm/+packages
>> https://launchpad.net/~stub/+archive/ubuntu/pgcharm/+files/wal-e_0.7.1-0%7E14%7Edaily%7Eubuntu14.04.1.dsc
>> https://launchpad.net/~stub/+archive/ubuntu/pgcharm/+files/wal-e_0.7.1-0%7E14%7Edaily%7Eubuntu14.04.1_all.deb
>>
>> It also requires the python-azure package from the same PPA:
>>
>> https://launchpad.net/~stub/+archive/ubuntu/pgcharm/+files/python-azure_0.8.1-0%7E5%7Eubuntu14.04.1.dsc
>>
>> Ubuntu 14.04 also requires a backport backports of python-swiftclient
>> 2.1.0. I was unable to obtain backports of this to releases earlier
>> than Ubuntu 14.04.
>>
>> Is this appropriate for apt.postgresql.org?
>
> It surely is.
>
>> How to I go about getting it included in apt.postgresql.org?
>
> At the moment, there's two mechanisms, building from some VCS repo
> (git, svn, bzr), or pulling the source from Debian unstable. Is there
> a VCS for the sources? (debian/ only is sufficient, the rest can come
> from upstream tarballs)

Its in bzr on Launchpad, lp:~stub/ubuntu/trusty/wal-e/trunk or
http://bazaar.launchpad.net/~stub/ubuntu/trusty/wal-e/trunk/files

# bzr-builder format 0.3 deb-version {debupstream}-0~{revno}~daily
lp:~stub/ubuntu/trusty/wal-e/trunk

The azure dependency is also in bzr at
lp:~stub/ubuntu/trusty/python-azure/trunk, recipe at
https://code.launchpad.net/~stub/+recipe/python-azure-daily

> In any case I prefer the package to also be in Debian, though that's
> not a strict requirement.
>
>> I am not a Debian Developer.
>
> Would you be interested to maintain the package in Debian? I can
> sponsor uploads.

I am interested. However, I don't have any Debian systems to test
with, so I don't know if it is practical or not. My main concern is
the dependencies.

--
Stuart Bishop <stuart(at)stuartbishop(dot)net>
http://www.stuartbishop.net/

Re: Stuart Bishop 2014-08-28 <CADmi=6Neo=nbkgmpdiK==-W+C081eUzZVDXJ0SxwTOQ6JVs-mA(at)mail(dot)gmail(dot)com>
> Its in bzr on Launchpad, lp:~stub/ubuntu/trusty/wal-e/trunk or
> http://bazaar.launchpad.net/~stub/ubuntu/trusty/wal-e/trunk/files
>
> # bzr-builder format 0.3 deb-version {debupstream}-0~{revno}~daily
> lp:~stub/ubuntu/trusty/wal-e/trunk
>
> The azure dependency is also in bzr at
> lp:~stub/ubuntu/trusty/python-azure/trunk, recipe at
> https://code.launchpad.net/~stub/+recipe/python-azure-daily

Ok, I'll have a look it.

> > Would you be interested to maintain the package in Debian? I can
> > sponsor uploads.
>
> I am interested. However, I don't have any Debian systems to test
> with, so I don't know if it is practical or not. My main concern is
> the dependencies.

Ideally the package would have testsuite in autopkgtest format. No
idea if it's testable without real S3 access or the like, but a basic
smoke test should be sufficient.

Christoph
--
cb(at)df7cb(dot)de | http://www.df7cb.de/

Re: To Stuart Bishop 2014-08-28 <20140828102741(dot)GD8293(at)msg(dot)df7cb(dot)de>
> Re: Stuart Bishop 2014-08-28 <CADmi=6Neo=nbkgmpdiK==-W+C081eUzZVDXJ0SxwTOQ6JVs-mA(at)mail(dot)gmail(dot)com>
> > Its in bzr on Launchpad, lp:~stub/ubuntu/trusty/wal-e/trunk or
> > http://bazaar.launchpad.net/~stub/ubuntu/trusty/wal-e/trunk/files
> >
> > # bzr-builder format 0.3 deb-version {debupstream}-0~{revno}~daily
> > lp:~stub/ubuntu/trusty/wal-e/trunk
> >
> > The azure dependency is also in bzr at
> > lp:~stub/ubuntu/trusty/python-azure/trunk, recipe at
> > https://code.launchpad.net/~stub/+recipe/python-azure-daily
>
> Ok, I'll have a look it.

Hi,

sorry for the late follow-up.

I actually looked at the packages a while ago and even added them to
apt.postgresql.org. I just didn't get around to reply here. IIRC
basically everything was fine, just a few minor things which I already
forgot again :-/ Looking again now...

wal-e:

debian/changelog would of course need "unstable" as dist

debian/control:
* the short Description shouldn't end in '.'
* Standards-Version is 3.9.6 now

There's a new upstream version available

python-azure:

The Description needs more text to explain what the package actually
does, including what Azure really is. Also, the long Description
should (mostly) be self-contained, i.e. not be a continuation of the
short Description.

debian/docs is empty, remove it

debian/compat is 9, but Build-Depends: debhelper is only >= 8

debian/copyright: "License: Apache License" should only be "License:
Apache" (or else Lintian complains)

There's also a new upstream version available

I'll upload to Debian once these are fixed, thanks for the packages!

> > > Would you be interested to maintain the package in Debian? I can
> > > sponsor uploads.
> >
> > I am interested. However, I don't have any Debian systems to test
> > with, so I don't know if it is practical or not. My main concern is
> > the dependencies.
>
> Ideally the package would have testsuite in autopkgtest format. No
> idea if it's testable without real S3 access or the like, but a basic
> smoke test should be sufficient.

(There is a "tests" directory in wal-e, but "python runtests.py" says
something about 0 items, and "make test" fails with some horrible mess
with $PATH and env.)

Christoph
--
cb(at)df7cb(dot)de | http://www.df7cb.de/

On 15 December 2014 at 17:53, Christoph Berg <cb(at)df7cb(dot)de> wrote:
> Re: To Stuart Bishop 2014-08-28 <20140828102741(dot)GD8293(at)msg(dot)df7cb(dot)de>
>> Re: Stuart Bishop 2014-08-28 <CADmi=6Neo=nbkgmpdiK==-W+C081eUzZVDXJ0SxwTOQ6JVs-mA(at)mail(dot)gmail(dot)com>
>> > Its in bzr on Launchpad, lp:~stub/ubuntu/trusty/wal-e/trunk or
>> > http://bazaar.launchpad.net/~stub/ubuntu/trusty/wal-e/trunk/files
>> >
>> > # bzr-builder format 0.3 deb-version {debupstream}-0~{revno}~daily
>> > lp:~stub/ubuntu/trusty/wal-e/trunk
>> >
>> > The azure dependency is also in bzr at
>> > lp:~stub/ubuntu/trusty/python-azure/trunk, recipe at
>> > https://code.launchpad.net/~stub/+recipe/python-azure-daily
>>
>> Ok, I'll have a look it.
>
> Hi,
>
> sorry for the late follow-up.

No problems. Now it is my turn to delay :-) Thanks for all your
feedback, and I'll make all your recommended changes once I've dug my
way out of the hole I'm currently in (next week if I'm lucky).

> I actually looked at the packages a while ago and even added them to
> apt.postgresql.org. I just didn't get around to reply here. IIRC
> basically everything was fine, just a few minor things which I already
> forgot again :-/ Looking again now...
>
> wal-e:
>
> debian/changelog would of course need "unstable" as dist
>
> debian/control:
> * the short Description shouldn't end in '.'
> * Standards-Version is 3.9.6 now
>
> There's a new upstream version available
>
> python-azure:
>
> The Description needs more text to explain what the package actually
> does, including what Azure really is. Also, the long Description
> should (mostly) be self-contained, i.e. not be a continuation of the
> short Description.
>
> debian/docs is empty, remove it
>
> debian/compat is 9, but Build-Depends: debhelper is only >= 8
>
> debian/copyright: "License: Apache License" should only be "License:
> Apache" (or else Lintian complains)
>
> There's also a new upstream version available
>
> I'll upload to Debian once these are fixed, thanks for the packages!
>
>> > > Would you be interested to maintain the package in Debian? I can
>> > > sponsor uploads.
>> >
>> > I am interested. However, I don't have any Debian systems to test
>> > with, so I don't know if it is practical or not. My main concern is
>> > the dependencies.
>>
>> Ideally the package would have testsuite in autopkgtest format. No
>> idea if it's testable without real S3 access or the like, but a basic
>> smoke test should be sufficient.
>
> (There is a "tests" directory in wal-e, but "python runtests.py" says
> something about 0 items, and "make test" fails with some horrible mess
> with $PATH and env.)
>
> Christoph
> --
> cb(at)df7cb(dot)de | http://www.df7cb.de/

--
Stuart Bishop <stuart(at)stuartbishop(dot)net>
http://www.stuartbishop.net/

On 15 December 2014 at 11:53, Christoph Berg <cb(at)df7cb(dot)de> wrote:
> Re: To Stuart Bishop 2014-08-28 <20140828102741(dot)GD8293(at)msg(dot)df7cb(dot)de>
>> Re: Stuart Bishop 2014-08-28 <CADmi=6Neo=nbkgmpdiK==-W+C081eUzZVDXJ0SxwTOQ6JVs-mA(at)mail(dot)gmail(dot)com>
>> > Its in bzr on Launchpad, lp:~stub/ubuntu/trusty/wal-e/trunk or
>> > http://bazaar.launchpad.net/~stub/ubuntu/trusty/wal-e/trunk/files
>> >
>> > # bzr-builder format 0.3 deb-version {debupstream}-0~{revno}~daily
>> > lp:~stub/ubuntu/trusty/wal-e/trunk
>> >
>> > The azure dependency is also in bzr at
>> > lp:~stub/ubuntu/trusty/python-azure/trunk, recipe at
>> > https://code.launchpad.net/~stub/+recipe/python-azure-daily
>>
>> Ok, I'll have a look it.
>
> Hi,
>
> sorry for the late follow-up.
>
> I actually looked at the packages a while ago and even added them to
> apt.postgresql.org. I just didn't get around to reply here. IIRC
> basically everything was fine, just a few minor things which I already
> forgot again :-/ Looking again now...

Hi Christoph.

I think I've made all the necessary changes to the wal-e and
python-azure packages now. I have also wired up the wal-e tests.

> wal-e:
>
> debian/changelog would of course need "unstable" as dist
>
> debian/control:
> * the short Description shouldn't end in '.'
> * Standards-Version is 3.9.6 now
>
> There's a new upstream version available
>
> python-azure:
>
> The Description needs more text to explain what the package actually
> does, including what Azure really is. Also, the long Description
> should (mostly) be self-contained, i.e. not be a continuation of the
> short Description.
>
> debian/docs is empty, remove it
>
> debian/compat is 9, but Build-Depends: debhelper is only >= 8
>
> debian/copyright: "License: Apache License" should only be "License:
> Apache" (or else Lintian complains)
>
> There's also a new upstream version available
>
> I'll upload to Debian once these are fixed, thanks for the packages!
>
>> > > Would you be interested to maintain the package in Debian? I can
>> > > sponsor uploads.
>> >
>> > I am interested. However, I don't have any Debian systems to test
>> > with, so I don't know if it is practical or not. My main concern is
>> > the dependencies.
>>
>> Ideally the package would have testsuite in autopkgtest format. No
>> idea if it's testable without real S3 access or the like, but a basic
>> smoke test should be sufficient.
>
> (There is a "tests" directory in wal-e, but "python runtests.py" says
> something about 0 items, and "make test" fails with some horrible mess
> with $PATH and env.)
>
> Christoph
> --
> cb(at)df7cb(dot)de | http://www.df7cb.de/

--
Stuart Bishop <stuart(at)stuartbishop(dot)net>
http://www.stuartbishop.net/