Project

General

Profile

Actions

Task #624

closed

migrate from WebDAV and Redmine file storage to Nextcloud

Added by Florian Effenberger over 9 years ago. Updated over 4 years ago.

Status:
Rejected
Priority:
Normal
Category:
-
Target version:
Team - Q4/2019
Start date:
Due date:
% Done:

0%

Tags:

Description

The WebDAV should be migrated to revisioned Nextcloud, ideally with encryption (of whatever kind)


Related issues

Is duplicate of Infrastructure - Feature #524: Create a concrete _proposal_ on how to use/migrate to git/sparkleshareClosedBjoern Michaelsen

Actions
Blocked by Infrastructure - Task #1477: pumbaa reinstallationClosedGuilhem Moulin

Actions
Actions #1

Updated by Bjoern Michaelsen over 9 years ago

  • Is duplicate of Feature #524: Create a concrete _proposal_ on how to use/migrate to git/sparkleshare added
Actions #2

Updated by Bjoern Michaelsen over 9 years ago

  • Status changed from Feedback to New

https://redmine.documentfoundation.org/issues/524 should have a pretty complete proposal and is marked resolved. Thus moving this one from Feedback to New.

Actions #3

Updated by Bjoern Michaelsen over 9 years ago

Florian Effenberger: Any reason for this one to be private? Esp. since the much more detailed 524 is public and links here?

Actions #4

Updated by Florian Effenberger over 9 years ago

Not really, no idea why I marked it private in first place...

Actions #5

Updated by Bjoern Michaelsen over 9 years ago

  • Description updated (diff)
Actions #6

Updated by Bjoern Michaelsen over 9 years ago

  • Private changed from Yes to No

unprivating then.

Actions #7

Updated by Bjoern Michaelsen over 9 years ago

  • Status changed from New to Closed

eh, resolved is not closed, so now doing the latter.

Actions #8

Updated by Bjoern Michaelsen over 9 years ago

  • Status changed from Closed to New

thank you Redmine for keeping two bugstates on duplicates except when closing. Very obvious behaviour, that.

Actions #9

Updated by Florian Effenberger over 9 years ago

  • Tracker changed from Feature to Task
Actions #10

Updated by Florian Effenberger over 9 years ago

  • Assignee deleted (Florian Effenberger)

No feedback, other urgent tasks, removing from my pile for the moment; can always re-open ticket later on

Actions #11

Updated by Alexander Werner over 9 years ago

  • Priority changed from Normal to Low
Actions #12

Updated by Michael Meeks over 9 years ago

Out of interest, why was this on your pile Florian, rather than on Alex's ? and why is it now a low priority ? from my POV that sucks rocks. Surely Alex can do the evaluation, and then train you in how to use it: get this - it is awesomely difficult - you just save your document on your file-system: just like dropbox ;-)

Please re-consider.

Actions #13

Updated by Florian Effenberger over 9 years ago

It was on my pile as I have to heavily rely on WebDAV on a daily basis
and there are quite a few dependencies - any disruption or change here
heavily affects my workflow, so I should be be involved to not run into
unpleasant surprises. Not necessarily doing the setup, but being involved.

My latest information is that it's not as trivial, and Björn raised a
couple of questions in #524 - the "read-only WebDAV" in milestone 2 is a
bit confusing to me, also the linking to gerrit in milestone 1, both of
which is different from what I understood in first place.

Asked quite a few times for feedback to no avail, thus de-prioritized it
for the moment.

Proposal: Quickly talk through it during the next board call I attend (2
weeks), and if considered important, advice on which of my tasks should
be de-prioritized for that to raise priority here.

Actions #14

Updated by Bjoern Michaelsen over 9 years ago

Florian Effenberger: IIRC we decided long ago, gerrit is not an option for hosting the WebDAV stuff (that was your opinion and I am fine with that). So we need to host the git repo standalone, which isnt a big thing anyway.

As for the "WebDAV is read-only" in milestone 2, yes that would mean Floeff needs to install and use Sparkleshare to push his changes. That should be a trivial change, but need Floeff to be prepare for on switchover day.

Actions #15

Updated by Florian Effenberger over 9 years ago

Briefly chatted with Michael, we should talk about it during the next
board call I'm there (if we can't manage before)

I recall that it was mentioned I can continue using as I do now,
Sparkleshare could do all the magic without me needing to use a client,
it is all trivial, so I don't have to change my tooling - so if that
isn't true anymore, it indeed needs some of my time factored in to
change my local tooling

I'm a bit confused now indeed ;-)
Let's defer to the phone, I'll add it to the agenda

Actions #16

Updated by Florian Effenberger over 9 years ago

Björn:

What I need your help with is migrating my rsync script I need for tax advise, which roughly looks like that:

rsync --include '2014*' --exclude '*' -azv /local_repoy/ /taxadvise_repo/

I also need to purge older data for a couple of reasons out of their repository, doing that like

MONTH=$(date +%m|sed 's/^0*//') ; let UPTOMONTH=MONTH-2 ; for ((i=1; i<=$UPTOMONTH; i++)) ; do find /taxadvise_repo/ -name *2014-$i* -exec rm {} \; ; done

Besides the fact that I'm obviously no coder :-) - any advice welcome on how to achieve that with SparkleShare.
In other words: I need to delete existing content from their fileshare, and only sync filenames with the last two, three months in the file name to it, while the main share has all the files.

Note the tax advise can most likely not install a client, but needs to use a web browser with HTTPS.

Actions #17

Updated by Bjoern Michaelsen over 9 years ago

Florian Effenberger wrote:

What I need your help with is migrating my rsync script I need for tax advise, which roughly looks like that:

Sparkleshare (or git) should give you a local copy of the repo anyway.

I also need to purge older data for a couple of reasons out of their repository, doing that like

As you will have a local copy, running the script locally and then pushing the change to the repo (Sparkleshare gives you a nice UI for the latter).

Note the tax advise can most likely not install a client, but needs to use a web browser with HTTPS.

Thats not a problem as they only need to read, not write.

Actions #18

Updated by Florian Effenberger over 9 years ago

  • Due date set to 2015-01-16
  • Assignee set to Alexander Werner
  • Priority changed from Low to Normal

Let's have a test drive mid-January and see the implications then, and go from there

Actions #19

Updated by Florian Effenberger over 8 years ago

  • Target version set to Pool
Actions #20

Updated by Florian Effenberger over 8 years ago

  • Due date deleted (2015-01-16)
  • Target version changed from Pool to Q1/2016
Actions #21

Updated by Alexander Werner about 8 years ago

  • Status changed from New to Feedback

It is unclear what needs to be done for the concrete evaluation from my side at the moment.

Actions #22

Updated by Florian Effenberger about 8 years ago

  • Subject changed from evaluate SparkleShare to migrate from WebDAV to SparkleShare
  • Status changed from Feedback to In Progress
  • Assignee changed from Alexander Werner to Florian Effenberger

Directly talked to Alex in the office to finally get this nailed down
We do have a repository that can be used, and I will do the next round of accounting via these means, to see if the interaction with the accountant works that way
Plan is that I feed the documents via git & rsync, accountant gets them via GitLab's web interface
If that works, we deploy that to a machine, migrate the existing WebDAV and change the accounting workflow

Actions #23

Updated by Florian Effenberger about 8 years ago

  • Target version changed from Q1/2016 to Q2/2016
Actions #26

Updated by Florian Effenberger about 8 years ago

  • Blocked by Task #1477: pumbaa reinstallation added
Actions #29

Updated by Florian Effenberger over 7 years ago

  • Target version changed from Q2/2016 to Qlater
Actions #31

Updated by Michael Meeks about 6 years ago

This is way obsolete - I guess we should move to the internal Next/ownCloud instead - and store/share everything there =)

Actions #32

Updated by Florian Effenberger about 6 years ago

  • Subject changed from migrate from WebDAV to SparkleShare to migrate from WebDAV to Nextcloud
  • Description updated (diff)

Indeed - I agree, so to some degree at least not the worst this didn't come to life yet
Changing the ticket's title and description to reflect the new approach

Actions #33

Updated by Florian Effenberger almost 6 years ago

Guilhem Moulin: We discussed this topic along some other items. Do you have insight into the Nextcloud encryption? Can sensitive documents be encrypted on a user-basis (i.e. it is encrypted towards user A, B, C, D's key, but not E, F, G, H, I's?). Are multiple users possible, i.e. if user B loses his password or is not available anymore, A, C, and D still have access, while E-I still don't?

Actions #34

Updated by Guilhem Moulin almost 6 years ago

Florian Effenberger wrote:

Guilhem Moulin: We discussed this topic along some other items. Do you have insight into the Nextcloud encryption? Can sensitive documents be encrypted on a user-basis (i.e. it is encrypted towards user A, B, C, D's key, but not E, F, G, H, I's?). Are multiple users possible, i.e. if user B loses his password or is not available anymore, A, C, and D still have access, while E-I still don't?

I have no idea, sorry :-/

Actions #35

Updated by Florian Effenberger almost 6 years ago

Can you find that out/test it? ;-)
There must be some documentation around that, otherwise you can run a
test with some team members maybe?

Actions #36

Updated by Michael Meeks almost 6 years ago

Guilhem Moulin: Do you have insight into the Nextcloud encryption?
Can sensitive documents be encrypted on a user-basis (i.e. it is encrypted
towards user A, B, C, D's key, but not E, F, G, H, I's?).

Yes.

Are multiple users possible, i.e. if user B loses his password or is
not available anymore, A, C, and D still have access, while E-I still don't?

Yes.

This is for the server-side encryption - the benefit of which is that the data is encrypted at-rest, although I guess when it is synched down to users it is expected that it is sucked onto an encrypted partition.

It works by having a new AES key per document (IIRC) - and then sharing that key by encrypting it with the relevant users' public keys that can see it (IIRC).

Some problems occur - of course, key-loss is tough-luck - but also if you don't encrypt files to start with then you need to re-share them with people - so I think you want to turn that feature on quite early - but I forget =)

Actions #37

Updated by Florian Effenberger over 5 years ago

  • Target version changed from Qlater to Q1/2019

With Nextcloud and LOOL being in production use, I indeed would like to merge the various sources of files. We have things in

  • Redmine files
  • WebDAV
  • Nextcloud

Guilhem and me can sit together at FOSDEM and play with some of the use cases, especially the encryption bits, and then I would like to proceed with migrating stuff and unifying access.

Actions #38

Updated by Florian Effenberger over 4 years ago

  • Subject changed from migrate from WebDAV to Nextcloud to migrate from WebDAV and Redmine file storage to Nextcloud
  • Target version changed from Q1/2019 to Q4/2019

This is one of the tasks identified for the admin assistant, to build a new and proper structure, so aiming to begin in Q4

Actions #40

Updated by Florian Effenberger over 4 years ago

  • Status changed from In Progress to Rejected

I'd like to close this old ticket in favor of #3022, which I will work on with Stephan early 2020
Let's keep this ticket referenced for the technical bits
With the accountant now also using Nextcloud a lot, the previous blocker is solved

The administrative part that involves Stephan and me is to come up with a proper structure
The pending technical items can be solved afterwards

Actions

Also available in: Atom PDF