Debian Bug report logs - #660826
RFP: elasticsearch -- Distributed, RESTful, Search Engine built on top of Apache Lucene

Package: wnpp; Maintainer for wnpp is wnpp@debian.org;

Reported by: Radu Gheorghe <radu0gheorghe@gmail.com>

Date: Wed, 22 Feb 2012 08:21:01 UTC

Severity: wishlist

Fix blocked by 736651: RFP: hyperic-sigar -- System Information Gatherer And Reporter, 736647: RFP: carrotsearch-hppc -- High Performance Primitive Collections for Java, 736645: RFP: netty-3.9 -- Java NIO client/server socket framework, 736652: RFP: compress-lzf -- basic LZF codec, compatible with standard C LZF package, 736653: RFP: spatial4j -- a general purpose spatial/geospatial Java library, 736644: RFP: lucene4 -- Full-text search engine library for Java

Reply or subscribe to this bug.

Toggle useless messages

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to debian-bugs-dist@lists.debian.org, wnpp@debian.org:
Bug#660826; Package wnpp. (Wed, 22 Feb 2012 08:21:04 GMT) Full text and rfc822 format available.

Acknowledgement sent to Radu Gheorghe <radu0gheorghe@gmail.com>:
New Bug report received and forwarded. Copy sent to wnpp@debian.org. (Wed, 22 Feb 2012 08:21:05 GMT) Full text and rfc822 format available.

Message #5 received at submit@bugs.debian.org (full text, mbox):

From: Radu Gheorghe <radu0gheorghe@gmail.com>
To: submit@bugs.debian.org
Subject: RFP: Elasticsearch -- Distributed, RESTful, Search Engine built on top of Apache Lucene
Date: Wed, 22 Feb 2012 10:18:30 +0200
Package: wnpp
Severity: wishlist

http://www.elasticsearch.com

ElasticSearch is a distributed RESTful search engine built for the
cloud. Features include:

- Distributed and Highly Available Search Engine.
  - Each index is fully sharded with a configurable number of shards.
  - Each shard can have one or more replicas.
  - Read / Search operations performed on either one of the replica shard.
- Multi Tenant with Multi Types.
  - Support for more than one index.
  - Support for more than one type per index.
  - Index level configuration (number of shards, index storage, …).
- Various set of APIs
  - HTTP RESTful API
  - Native Java API.
  - All APIs perform automatic node operation rerouting.
- Document oriented
  - No need for upfront schema definition.
  - Schema can be defined per type for customization of the indexing process.
- Reliable, Asynchronous Write Behind for long term persistency.
- (Near) Real Time Search.
- Built on top of Lucene
  - Each shard is a fully functional Lucene index
  - All the power of Lucene easily exposed through simple
configuration / plugins.
- Per operation consistency
  - Single document level operations are atomic, consistent, isolated
and durable.
- Open Source under Apache 2 License.

The current version is this this one:
http://www.elasticsearch.org/download/2012/02/21/0.19.0.RC3.html
And you can find the sources here:
https://github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.0.RC3.tar.gz
and a .deb package here:
https://github.com/downloads/elasticsearch/elasticsearch/elasticsearch-0.19.0.RC3.deb

I would love to see Elasticsearch in Debian. I'm not sure how package
maintenance will be done, since they build .deb packages as well. If
there's any need for help, I would volunteer for maintaining the
package.

Best regards,
Radu




Changed Bug title to 'RFP: elasticsearch -- Distributed, RESTful, Search Engine built on top of Apache Lucene' from 'RFP: Elasticsearch -- Distributed, RESTful, Search Engine built on top of Apache Lucene' Request was from Raphael Geissert <atomo64@gmail.com> to control@bugs.debian.org. (Thu, 23 Feb 2012 03:15:23 GMT) Full text and rfc822 format available.

Information forwarded to debian-bugs-dist@lists.debian.org, wnpp@debian.org:
Bug#660826; Package wnpp. (Sun, 28 Oct 2012 01:33:06 GMT) Full text and rfc822 format available.

Acknowledgement sent to Nicholas Robinson-Wall <nick@robinson-wall.com>:
Extra info received and forwarded to list. Copy sent to wnpp@debian.org. (Sun, 28 Oct 2012 01:33:06 GMT) Full text and rfc822 format available.

Message #12 received at 660826@bugs.debian.org (full text, mbox):

From: Nicholas Robinson-Wall <nick@robinson-wall.com>
To: 660826@bugs.debian.org, Radu Gheorghe <radu0gheorghe@gmail.com>
Subject: Re: RFP: Elasticsearch -- Distributed, RESTful, Search Engine built on top of Apache Lucene
Date: Sun, 28 Oct 2012 01:30:54 +0000
> I would love to see Elasticsearch in Debian. I'm not sure how package
> maintenance will be done, since they build .deb packages as well.

I make heavy use of Elasticsearch at work and would like to see a package
in Debian as well. The upstream .deb is generated by Maven using jdeb
and is consequently full of lintian warnings and errors.

> I would volunteer for maintaining the package

As would I. Are you still interested in maintaining, or even comaintaining?

I plan on looking at the feasibility of a proper (non-jdeb) package for this
shortly, and changing this to an ITP if it looks doable. Involving upstream in
some capacity might also be advisable, given their obvious interest in
providing Debian support.

Regards,
Nicholas Robinson-Wall


Information forwarded to debian-bugs-dist@lists.debian.org, wnpp@debian.org:
Bug#660826; Package wnpp. (Tue, 30 Oct 2012 09:12:03 GMT) Full text and rfc822 format available.

Acknowledgement sent to Radu Gheorghe <radu0gheorghe@gmail.com>:
Extra info received and forwarded to list. Copy sent to wnpp@debian.org. (Tue, 30 Oct 2012 09:12:03 GMT) Full text and rfc822 format available.

Message #17 received at 660826@bugs.debian.org (full text, mbox):

From: Radu Gheorghe <radu0gheorghe@gmail.com>
To: Nicholas Robinson-Wall <nick@robinson-wall.com>
Cc: 660826@bugs.debian.org
Subject: Re: RFP: Elasticsearch -- Distributed, RESTful, Search Engine built on top of Apache Lucene
Date: Tue, 30 Oct 2012 11:10:28 +0200
Hi Nicholas,

2012/10/28 Nicholas Robinson-Wall <nick@robinson-wall.com>:
>> I would love to see Elasticsearch in Debian. I'm not sure how package
>> maintenance will be done, since they build .deb packages as well.
>
> I make heavy use of Elasticsearch at work and would like to see a package
> in Debian as well. The upstream .deb is generated by Maven using jdeb
> and is consequently full of lintian warnings and errors.

Yeah, that's a problem indeed. I saw it after opening this bug.

>
>> I would volunteer for maintaining the package
>
> As would I. Are you still interested in maintaining, or even comaintaining?

Yes, I'm actually more involved with ES now than I was a while ago. I
almost forgot about it because I didn't see any reaction to this bug.
Until now :)

>
> I plan on looking at the feasibility of a proper (non-jdeb) package for this
> shortly, and changing this to an ITP if it looks doable.

That sounds really nice, thank you. Maybe we can come up with a plan
on how to go further.

> Involving upstream in
> some capacity might also be advisable, given their obvious interest in
> providing Debian support.

Yeah, given how active the ES world is, I'm pretty sure they'd help.

Best regards,
Radu



Information forwarded to debian-bugs-dist@lists.debian.org, wnpp@debian.org:
Bug#660826; Package wnpp. (Tue, 30 Oct 2012 10:27:03 GMT) Full text and rfc822 format available.

Acknowledgement sent to Nick Robinson-Wall <nick@robinson-wall.com>:
Extra info received and forwarded to list. Copy sent to wnpp@debian.org. (Tue, 30 Oct 2012 10:27:03 GMT) Full text and rfc822 format available.

Message #22 received at 660826@bugs.debian.org (full text, mbox):

From: Nick Robinson-Wall <nick@robinson-wall.com>
To: Radu Gheorghe <radu0gheorghe@gmail.com>
Cc: "660826@bugs.debian.org" <660826@bugs.debian.org>
Subject: Re: RFP: Elasticsearch -- Distributed, RESTful, Search Engine built on top of Apache Lucene
Date: Tue, 30 Oct 2012 10:25:34 +0000
[Message part 1 (text/plain, inline)]
Hi Radu,

On 30 Oct 2012, at 09:10, Radu Gheorghe <radu0gheorghe@gmail.com> wrote:


Yeah, that's a problem indeed. I saw it after opening this bug.


I've had a look into it a bit deeper. There are a few problems with
packaging based on the upstream tarball as it stands. The biggest seems to
be that it ships pre-compiled libsigar.

There isn't a pre-existing package for this. I have yet to take a detailed
look at it but at first glance it seemed like it would be a reasonably
simple exercise to create. I have yet to check for packages for all of its
Java dependencies.


Yes, I'm actually more involved with ES now than I was a while ago. I
almost forgot about it because I didn't see any reaction to this bug.
Until now :)


Excellent. Having someone involved upstream will certainly smooth the
process :)


That sounds really nice, thank you. Maybe we can come up with a plan
on how to go further.


Perhaps you would be able to take a look through
http://wiki.debian.org/UpstreamGuide ? Of particular interest is the
section on Java.


I will have a quick stab at a very basic package and identify any obvious
blockers for us. If it looks doable I suggest we convert this to an ITP.

Regards,
Nick
[Message part 2 (text/html, inline)]

Information forwarded to debian-bugs-dist@lists.debian.org, wnpp@debian.org:
Bug#660826; Package wnpp. (Tue, 30 Oct 2012 11:42:02 GMT) Full text and rfc822 format available.

Acknowledgement sent to Radu Gheorghe <radu0gheorghe@gmail.com>:
Extra info received and forwarded to list. Copy sent to wnpp@debian.org. (Tue, 30 Oct 2012 11:42:02 GMT) Full text and rfc822 format available.

Message #27 received at 660826@bugs.debian.org (full text, mbox):

From: Radu Gheorghe <radu0gheorghe@gmail.com>
To: Nick Robinson-Wall <nick@robinson-wall.com>
Cc: "660826@bugs.debian.org" <660826@bugs.debian.org>
Subject: Re: RFP: Elasticsearch -- Distributed, RESTful, Search Engine built on top of Apache Lucene
Date: Tue, 30 Oct 2012 13:38:26 +0200
Hi Nick,

2012/10/30 Nick Robinson-Wall <nick@robinson-wall.com>:
> I've had a look into it a bit deeper. There are a few problems with
> packaging based on the upstream tarball as it stands. The biggest seems to
> be that it ships pre-compiled libsigar.
>
> There isn't a pre-existing package for this. I have yet to take a detailed
> look at it but at first glance it seemed like it would be a reasonably
> simple exercise to create. I have yet to check for packages for all of its
> Java dependencies.
>

So that means that there should be a different Debian package for
libsigar, right? And the same for all other dependencies, I guess.

>
> Perhaps you would be able to take a look through
> http://wiki.debian.org/UpstreamGuide ? Of particular interest is the section
> on Java.

Done :)

>
>
> I will have a quick stab at a very basic package and identify any obvious
> blockers for us. If it looks doable I suggest we convert this to an ITP.

Agreed :) Please feel free to delegate where you think I could help you.



Added blocking bug(s) of 660826: 58903 Request was from Nicholas Robinson-Wall <nick@robinson-wall.com> to control@bugs.debian.org. (Tue, 30 Oct 2012 15:42:05 GMT) Full text and rfc822 format available.

Information forwarded to debian-bugs-dist@lists.debian.org, wnpp@debian.org:
Bug#660826; Package wnpp. (Thu, 14 Mar 2013 16:45:03 GMT) Full text and rfc822 format available.

Acknowledgement sent to Apollon Oikonomopoulos <apoikos@gmail.com>:
Extra info received and forwarded to list. Copy sent to wnpp@debian.org. (Thu, 14 Mar 2013 16:45:03 GMT) Full text and rfc822 format available.

Message #34 received at 660826@bugs.debian.org (full text, mbox):

From: Apollon Oikonomopoulos <apoikos@gmail.com>
To: Radu Gheorghe <radu0gheorghe@gmail.com>, Nick Robinson-Wall <nick@robinson-wall.com>
Cc: 660826@bugs.debian.org
Subject: Re: RFP: Elasticsearch -- Distributed, RESTful, Search Engine built on top of Apache Lucene
Date: Thu, 14 Mar 2013 18:34:00 +0200
Hi Radu, Nick,

Any news on this? We're also making heavy use of elasticsearch in our 
main service and would be glad to help package/maintain it properly.

Regards,
Apollon



Information forwarded to debian-bugs-dist@lists.debian.org, wnpp@debian.org:
Bug#660826; Package wnpp. (Fri, 15 Mar 2013 19:57:47 GMT) Full text and rfc822 format available.

Acknowledgement sent to Radu Gheorghe <radu0gheorghe@gmail.com>:
Extra info received and forwarded to list. Copy sent to wnpp@debian.org. (Fri, 15 Mar 2013 19:57:47 GMT) Full text and rfc822 format available.

Message #39 received at 660826@bugs.debian.org (full text, mbox):

From: Radu Gheorghe <radu0gheorghe@gmail.com>
To: Apollon Oikonomopoulos <apoikos@gmail.com>
Cc: Nick Robinson-Wall <nick@robinson-wall.com>, "660826@bugs.debian.org" <660826@bugs.debian.org>
Subject: Re: RFP: Elasticsearch -- Distributed, RESTful, Search Engine built on top of Apache Lucene
Date: Fri, 15 Mar 2013 10:03:42 +0200
[Message part 1 (text/plain, inline)]
Hi Apollon,

Sorry, I didn't have the time to make any progress on this. But any kind of
help will definitely welcome :)

Best regards,
Radu

2013/3/14 Apollon Oikonomopoulos <apoikos@gmail.com>

> Hi Radu, Nick,
>
> Any news on this? We're also making heavy use of elasticsearch in our
> main service and would be glad to help package/maintain it properly.
>
> Regards,
> Apollon
>
[Message part 2 (text/html, inline)]

Information forwarded to debian-bugs-dist@lists.debian.org, wnpp@debian.org:
Bug#660826; Package wnpp. (Thu, 23 Jan 2014 23:48:05 GMT) Full text and rfc822 format available.

Acknowledgement sent to Hilko Bengen <bengen@debian.org>:
Extra info received and forwarded to list. Copy sent to wnpp@debian.org. (Thu, 23 Jan 2014 23:48:05 GMT) Full text and rfc822 format available.

Message #44 received at 660826@bugs.debian.org (full text, mbox):

From: Hilko Bengen <bengen@debian.org>
To: debian-java@lists.debian.org
Cc: 660826@bugs.debian.org
Subject: For those who care about ElasticSearch: build dependencies, RFH
Date: Fri, 24 Jan 2014 00:43:51 +0100
After struggling off and on with several projects' mostly Maven-based
build systems (and our tool support for Maven), I have finally gotten
ElasticSearch 1.0.0 RC1 to build on a Debian/unstable box without
network connectivity. The dependencies used to build the package have
been provided through individual locally built Debian packages.

I do not feel comfortable with uploading the dozen-or-so packages to
unstable right away because the quality of those packages is not up to
my standards and I do not really want to maintain them myself. I am no
Java developer and I have found out just enough about Maven and
maven-*-helper to be able to cause some damage using copy&paste
techniques. (I have, however, come to form strong opinions about
software library models that are based upon eternal availability of
unmaintained, buggy versions rather than a desire to provide stable
APIs/ABIs. But I digress.)

So, I need some help.

As a first step, I am going to document the various required
dependencies in the form of RFP bugs that are going to be linked to this
bug (#660826: RFP Elasticsearch) and I will try to make my efforts
available through git repositories as a possible starting point for
whoever wants to pick up from there.

The following packages that are not yet in Debian were needed:

- Apache Lucene 4.6 (lucene3 which is available is not enough.)
- A newer netty (3.9.0.Final is wanted, we have 3.2.6.Final in
  unstable.)
- spatial4j
- compress-lzf 0.9.6 (API breakage with a class becoming abstract after
  that. WTF?)
- hyperic-sigar
- carrotsearch-hppc
- icu4j-49 (Not sure if the exact "major" version is needed or if it's
  possible to just go the current fifty-something version instead.)

Cheers,
-Hilko



Information forwarded to debian-bugs-dist@lists.debian.org, wnpp@debian.org:
Bug#660826; Package wnpp. (Fri, 24 Jan 2014 14:06:10 GMT) Full text and rfc822 format available.

Acknowledgement sent to Hilko Bengen <bengen@debian.org>:
Extra info received and forwarded to list. Copy sent to wnpp@debian.org. (Fri, 24 Jan 2014 14:06:10 GMT) Full text and rfc822 format available.

Message #49 received at 660826@bugs.debian.org (full text, mbox):

From: Hilko Bengen <bengen@debian.org>
To: 660826@bugs.debian.org
Subject: Another (indirect) build dependency
Date: Fri, 24 Jan 2014 15:00:22 +0100
morfologik-stemming 1.8.3 is needed to build lucene4



Information forwarded to debian-bugs-dist@lists.debian.org, wnpp@debian.org:
Bug#660826; Package wnpp. (Fri, 24 Jan 2014 18:15:04 GMT) Full text and rfc822 format available.

Acknowledgement sent to Sylvestre Ledru <sylvestre@debian.org>:
Extra info received and forwarded to list. Copy sent to wnpp@debian.org. (Fri, 24 Jan 2014 18:15:04 GMT) Full text and rfc822 format available.

Message #54 received at 660826@bugs.debian.org (full text, mbox):

From: Sylvestre Ledru <sylvestre@debian.org>
To: Hilko Bengen <bengen@debian.org>
Cc: debian-java@lists.debian.org, 660826@bugs.debian.org
Subject: Re: For those who care about ElasticSearch: build dependencies, RFH
Date: Fri, 24 Jan 2014 19:11:29 -0800
Hello

Congratulations!

On 23/01/2014 15:43, Hilko Bengen wrote:
> As a first step, I am going to document the various required
> dependencies in the form of RFP bugs that are going to be linked to this
> bug (#660826: RFP Elasticsearch) and I will try to make my efforts
> available through git repositories as a possible starting point for
> whoever wants to pick up from there.
>
> The following packages that are not yet in Debian were needed:
>
> - Apache Lucene 4.6 (lucene3 which is available is not enough.)
> - A newer netty (3.9.0.Final is wanted, we have 3.2.6.Final in
>   unstable.)
> - spatial4j
> - compress-lzf 0.9.6 (API breakage with a class becoming abstract after
>   that. WTF?)
> - hyperic-sigar
> - carrotsearch-hppc
> - icu4j-49 (Not sure if the exact "major" version is needed or if it's
>   possible to just go the current fifty-something version instead.)

Just to make sure I understand, you did the proof of concept but you are
not planning to go forward.
You are looking for people to complete the work ?

Cheers,
Sylvestre




Information forwarded to debian-bugs-dist@lists.debian.org, wnpp@debian.org:
Bug#660826; Package wnpp. (Fri, 24 Jan 2014 19:18:10 GMT) Full text and rfc822 format available.

Acknowledgement sent to Hilko Bengen <bengen@debian.org>:
Extra info received and forwarded to list. Copy sent to wnpp@debian.org. (Fri, 24 Jan 2014 19:18:10 GMT) Full text and rfc822 format available.

Message #59 received at 660826@bugs.debian.org (full text, mbox):

From: Hilko Bengen <bengen@debian.org>
To: Sylvestre Ledru <sylvestre@debian.org>
Cc: debian-java@lists.debian.org, 660826@bugs.debian.org
Subject: Re: For those who care about ElasticSearch: build dependencies, RFH
Date: Fri, 24 Jan 2014 20:15:59 +0100
* Sylvestre Ledru:

> Just to make sure I understand, you did the proof of concept but you
> are not planning to go forward.

I see most of the listed packages as means to an end: a working ES
package that can be built from sources without having to deal with the
Maven-specific assumptions that are simply broken from Debian's point of
view.

As stated, I am no Java developer and don't really understand Maven and
Debian's tools to deal with Maven well enough to fix problems --
therefore I don't really see myself as competent in maintaining those
packages.

> You are looking for people to complete the work ?

Pretty much. I am looking for people to take over maintainership of the
packages that ElasticSearch depends upon.

Now, I could have just put a line like

    Maintainer: Debian Java maintainers <pkg-java-maintainers@lists.alioth.debian.org>

into the debian/control files and could have just uploaded the packages
after posting quick ITPs with a plan to immediately forget about the
packages, but that's what I'd consider antisocial behavior.

Cheers,
-Hilko



Added blocking bug(s) of 660826: 736644 Request was from Hilko Bengen <bengen@debian.org> to submit@bugs.debian.org. (Sat, 25 Jan 2014 19:21:06 GMT) Full text and rfc822 format available.

Added blocking bug(s) of 660826: 736645 Request was from Hilko Bengen <bengen@debian.org> to submit@bugs.debian.org. (Sat, 25 Jan 2014 19:21:13 GMT) Full text and rfc822 format available.

Added blocking bug(s) of 660826: 736647 Request was from Hilko Bengen <bengen@debian.org> to submit@bugs.debian.org. (Sat, 25 Jan 2014 19:27:11 GMT) Full text and rfc822 format available.

Added blocking bug(s) of 660826: 736651 Request was from Hilko Bengen <bengen@debian.org> to submit@bugs.debian.org. (Sat, 25 Jan 2014 19:36:12 GMT) Full text and rfc822 format available.

Added blocking bug(s) of 660826: 736652 Request was from Hilko Bengen <bengen@debian.org> to submit@bugs.debian.org. (Sat, 25 Jan 2014 19:36:18 GMT) Full text and rfc822 format available.

Added blocking bug(s) of 660826: 736653 Request was from Hilko Bengen <bengen@debian.org> to submit@bugs.debian.org. (Sat, 25 Jan 2014 19:36:25 GMT) Full text and rfc822 format available.

Send a report that this bug log contains spam.


Debian bug tracking system administrator <owner@bugs.debian.org>. Last modified: Thu Apr 17 21:49:48 2014; Machine Name: buxtehude.debian.org

Debian Bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.