[CWB] Corpus installation - admin v user
Michael Lynch
m.lynch at sydney.edu.au
Fri Apr 21 06:13:53 CEST 2023
Hi all,
I’ve been looking at ways around a problem with installing large corpora on our installation of CQPweb.
Our university’s firewall cuts off web connections after around 20 seconds, which means that indexing and installing corpora over a certain size via the admin interface gets interrupted.
The workaround for this so far has been to index and add metadata using command-line tools on the server, but I’d like to get installation working via the web interface.
I’ve been looking through the CQPweb source, and have noticed that the process for user-installed corpora is managed using a job queue, which means that in theory it wouldn’t get interrupted by the firewall timeout.
Is there any plan to rework the admin corpus installation code so that it uses the same queuing system?
Alternatively, are there any differences between user- and admin-installed corpora, in terms of the functionality available once they’re installed?
At the moment, we don’t allow users to upload corpora, but if we could grant installation privileges to our admin users so that they can install corpora using the user-installed system, it could be a way around the firewall problem
Regards,
Mike
Mike Lynch (he/him) | Research Engineer Group Lead
The University of Sydney
Sydney Informatics Hub | Core Research Facilities
M +61 478 872 039 | E m.lynch at sydney.edu.au
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://liste.sslmit.unibo.it/pipermail/cwb/attachments/20230421/c79397fa/attachment.html>
More information about the CWB
mailing list