Significant performance issue in copy version

Description

Pre:

  • A large gettext file. I created on from Gutenberg's Moby Dick.

  • Many languages for the project are enabled, e.g. the default language set as seen on t.z.o

1. Upload a large gettext file to a project version. Go back to the projects page
2. Clone the version by clicking the down arrow on the version and selecting Copy to new version
3. Enter a new id, and press create
4. Repeat steps 2 - 3 on the same original version

Two versions are now being created. Where one version would take some minutes to complete, this one takes around an hour to fail (out of heap space). At least, it did on my machine (T530, 8GB RAM, i7-3520M CPU @ 2.90GHz)

Environment

Fedora22, firefox, T530, wildfly 10

Attachments

3

relates to

Activity

Show:

Former user 16 November 2016 at 05:29

Can not reproduce it with restricted heap size (1g). Some code and tests are changed during the process so will use this issue for tracking.

Former user 16 November 2016 at 00:50

The start time is the memory recording time (from a fresh server start). The end time is after 50 min or so which it's after the big spike in memory. I've also got a heap dump file and eclipse MAT reports the memory dominator is hibernate SessionFactoryImpl with a lot of query plan cache.

I am going to restrict heap size to 1g and try again.

Sean Flanigan 16 November 2016 at 00:25

That chart doesn't tell us much without more information. For instance, what time did the copy start and finish?

Former user 16 November 2016 at 00:15

re-run with 40 languages enabled and the completion time is about the same. Heap dump as attached

doesn't seem to have memory leak as the memory usage is back to normal after the run.

Former user 14 November 2016 at 23:23
Edited

Tested locally using the attached file plus one language 100% translated. Started 2 copy version processes simultaneously and they both finished around the same time. Log message modified for easier viewing

Ready for Release

Details

Assignee

Reporter

Labels

Tested Version/s

Story Points

Components

Sprint

Affects versions

Priority

More fields

Created 20 May 2016 at 03:02
Updated 27 June 2018 at 02:24
Resolved 22 November 2016 at 06:03