[Samba] Fwd: Wsearch
npower
npower at samba.org
Fri Feb 17 16:30:19 UTC 2023
need to remember to mail from my samba.org address :-)
-------- Forwarded Message --------
Subject: Re: [Samba] Wsearch
Date: Fri, 17 Feb 2023 16:28:29 +0000
From: Noel Power <nopower at suse.de>
To: Kees van Vloten <keesvanvloten at gmail.com>, npower via samba
<samba at lists.samba.org>
Hi Kees
On 17/02/2023 10:56, Kees van Vloten via samba wrote:
> Hi Noel,
>
>
> As we discussed on the list, I busy getting the bits and pieces in
> place to be able to test your windows search work.
>
> I am running all my stuff on Debian Bullseye, with Samba code in 3
> lxc-containers. Two are for the DCs, one is the fileserver. Everything
> is managed by Ansible code, I try to avoid manual changes to my
> environment(s) as much as possible. Generally manual changes are to
> test something and when it works I put it in code.
>
> The fileserver-container uses a mounted host directory to store the
> file shares.
>
> In the mean time I have installed Opensearch on the host. Opensearch
> is binary compatible with Elasticsearch 7.x and that is what FSCrawler
> requires, so should just work.
as mentioned before, haven't used opensearch so I have no idea what, or
if there are any differences with elasticsearch or indeed how any such
differences might affect the WSP server implementation.
>
> Now I was looking at FSCrawler and I noticed the last release with
> compiled code is 2.7, is that version alright? I guess we do not want
> to run into issues in FSCrawler while working on Samba, hence 2.10
> snapshots feel like a bad idea.
> /Did you find 2.9 binaries somewhere or how do you deal with this?/
so, the version of fscrawler I last tested with is
fscrawler-es7-2.7-SNAPSHOT
> For communication between Samba and Opensearch I will apply the code
> patch from Awen Saunders (Authorization header in smb.conf). Although
> not secure it is good enough for this testing.
sure, I just use anonymous :-) (but you need to do some configuration
steps that I don't remember to get that to work with tls)
>
> As for Samba I have setup build code to create debian packages from
> https://salsa.debian.org/samba-team/samba. That delivers me .deb
> packages which can be installed with my automation on the fileserver.
hmmm, I am currently trying to get this the server to work/build against
master, I'd be willing to backport it to 4.17 or 4.18 but don't see much
value in backporting it further back just for testing
>
> I guess that is not what we want for this project. My latest idea is
> to deploy a second fileserver container, specifically for this work.
> /How do you build and install samba for dev and test work?/
I just build and run directly from the source tree, if you know the
correct options (e.g. for debian? ) to pass to configure, then in the
container you could probably easily just do 'make install' and it should
overwrite whatever version is there. The distro config options would
probably need to be changed a little so that you build and use the
correct versions of ldb/talloc/tevent etc. instead of using the system ones
>
> Since FSCrawler will index the shares, I was thinking of installing it
> on the host and not in the fileserver-container. That helps when there
> are 2 fileserver-containers that work on the same underlying host
> storage (one for this work and the regular one). That reduces
> duplication and keeps the containers lean.
> /Would there be any objections with this approach?/
whenever I tested this, it was with a very simple setup, I just run
elasticsearch on my local dev machine, I point fscrawler at a particular
share I use for testing to create the index and that's it. After that I
use my own 'wspsearch' client or connect a windows client and perform
searches from the file explorer/browser
I think whatever way you want to configure your system is entirely up
to you :-), at the end of the day the wsp server only needs to be able
to talk to the elasticsearch instance to query it. In fact I think I
only ever ran fscrawler once :-)
>
>
> A lot of progress on my side but not yet ready :-)
>
> - Kees.
>
I hope to have a working (well working for simple searches at least) wsp
early next week
Noel
More information about the samba
mailing list