# Fix performance issue on large password database (2k / 4k passwords) **URL:** \ **Category:** Done!\ **Created:** [March 26, 2018, 12:23pm UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493 "2018-03-26T12:23:53Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![eddie4](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/eddie4/32/96_2.png) [@eddie4](https://community.passbolt.com/u/eddie4)\ **Post date:** [March 26, 2018, 12:23pm UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/1 "2018-03-26T12:23:53Z")
We just imported our password database and we ran into performance issues like a brickwall. We currently are on 2100 passwords and when the whole import is done we will likely be around 4000 passwords. Currently it takes 13 seconds for chrome to load the password overview and 62 seconds for firefox (gives warnings). The server is chilling and not doing much but the clients are on 70% cpu load. Am thinking that the plugin should perhaps get 50 passwords sorted on favorites and place the others on other pages. info: Passbolt version: 1.6.5 Client hardware: i5 7360U 16GB mem 1GBit connection to server Client software: Chrome 65.0.3325.181 & Firefox 59.0.1 (64-bits) Server hardware: 2 xeon processing cores 4GB mem (600MB in use) Server response info: 2096 passwords 456 milliseconds 4MB response (3,948,897 bytes) from GET /resources.json?silentLoading=false&order%5B%5D=Resource.modified+DESC Other sorts result in the same performance issue. With the exception of groups that have fewer passwords. EDIT: Please note that searching is pretty fast and clearing search loads results under a second on both Firefox and Chrome. I have a feeling that the plugin is verifying the signatures which takes a long time. ---
**Author:** ![remy](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/remy/32/17_2.png) [@remy](https://community.passbolt.com/u/remy)\ **Post date:** [March 27, 2018, 6:15am UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/2 "2018-03-27T06:15:59Z")
@eddie4 thanks for the report, we’ll do a large fixture set to try to reproduce the setup with the v2 and see where we can squeeze some more performance. ---
**Author:** ![OdyX](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/odyx/32/106_2.png) [@OdyX](https://community.passbolt.com/u/OdyX)\ **Post date:** [March 27, 2018, 11:12am UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/3 "2018-03-27T11:12:41Z")
The obvious would be to paginate the results, and allow API-side password search instead of always loading all passwords. ---
**Author:** ![remy](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/remy/32/17_2.png) [@remy](https://community.passbolt.com/u/remy)\ **Post date:** [March 27, 2018, 11:31am UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/4 "2018-03-27T11:31:40Z")
Yes, @cedric also started working on getting the secrets and keys separately only when needed, this will decrease the size of the request and improve front-end performance drastically. This is something we aim at doing in april. ---
**Author:** ![eddie4](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/eddie4/32/96_2.png) [@eddie4](https://community.passbolt.com/u/eddie4)\ **Post date:** [March 29, 2018, 11:36am UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/5 "2018-03-29T11:36:39Z")
Yes please let me know if v2 fixes the problem or when there is a fix available. ---
**Author:** ![remy](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/remy/32/17_2.png) [@remy](https://community.passbolt.com/u/remy)\ **Post date:** [April 11, 2018, 5:43pm UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/6 "2018-04-11T17:43:41Z")
We’ll be working on fix shortly and let you know when it’s available. Thank you for your patience. ---
**Author:** ![eddie4](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/eddie4/32/96_2.png) [@eddie4](https://community.passbolt.com/u/eddie4)\ **Post date:** [May 1, 2018, 1:16pm UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/7 "2018-05-01T13:16:36Z")
Is there anyway that i can help? I am willing to spend a few hours running a alpha release. ---
**Author:** ![remy](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/remy/32/17_2.png) [@remy](https://community.passbolt.com/u/remy)\ **Post date:** [May 1, 2018, 1:25pm UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/8 "2018-05-01T13:25:45Z")
This items depends on a larger framework upgrade that @cedric is working on. We’ll ping you when we have something to test. Thank you for your patience. ---
**Author:** ![Nikolay](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/nikolay/32/202_2.png) [@Nikolay](https://community.passbolt.com/u/Nikolay)\ **Post date:** [May 10, 2018, 7:01am UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/9 "2018-05-10T07:01:24Z")
Hey, We’ve got the same issue like @eddie4 . We’ve imported 2400 passwords to the latest pro version of passbolt and the browser crashes. It will be nice to have pagination, so we can use the passbolt app. Thank you! ---
**Author:** ![Nikolay](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/nikolay/32/202_2.png) [@Nikolay](https://community.passbolt.com/u/Nikolay)\ **Post date:** [June 25, 2018, 8:37am UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/10 "2018-06-25T08:37:33Z")
Hi guys! Is there any update on this issue ? Thank you =) ---
**Author:** ![kevin](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/kevin/32/128_2.png) [@kevin](https://community.passbolt.com/u/kevin)\ **Post date:** [June 25, 2018, 10:57am UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/11 "2018-06-25T10:57:48Z")
Hi @Nikolay, It is among the top priorities in our backlog and will be tackled as soon as we can. @cedric has already fixed the main blocker (quite a painful one), which was the upgrade the underlying canjs framework. There are a few things cooking and this performance issue is part of it. Please bear with us a little longer 🙂 Cheers, ---
**Author:** ![eddie4](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/eddie4/32/96_2.png) [@eddie4](https://community.passbolt.com/u/eddie4)\ **Post date:** [July 6, 2018, 8:31am UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/12 "2018-07-06T08:31:10Z")
I have been visiting this topic every week from when I opened the issue. As this is an opensource project I didn’t want put pressure on you guys. However the patience of the business has started to run out and they are discussing switching to an alternative. Originally the date for the fix was mid April. Now we are 3 months over that date. Can you guys give us a bit more of a hard deadline would a bounty help getting this fixed or ? ---
**Author:** ![cedric](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/cedric/32/3868_2.png) [@cedric](https://community.passbolt.com/u/cedric)\ **Post date:** [July 6, 2018, 8:40am UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/13 "2018-07-06T08:40:24Z")
Hey @eddie4, We already wrote the spec, the issue is planned to be fixed in the next release or the one after, it will be fixed this month. ---
**Author:** ![eddie4](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/eddie4/32/96_2.png) [@eddie4](https://community.passbolt.com/u/eddie4)\ **Post date:** [July 6, 2018, 12:46pm UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/14 "2018-07-06T12:46:43Z")
Awesome, I talked to the big chief here and we will offer a bounty of 150 euro if it is indeed done this month. I understand you guys have a premium product but we already wrote our own import tool and we would prefer to support you guys this way. Energy drinks & beer will be on us. ---
**Author:** ![Cordeos](https://avatars.discourse-cdn.com/v4/letter/c/67e7ee/32.png) [@Cordeos](https://community.passbolt.com/u/Cordeos)\ **Post date:** [July 10, 2018, 9:44am UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/15 "2018-07-10T09:44:47Z")
Pagination would be great… but improving server performance quickly takes only about 12 lines of code… 1. by default open to ‘Favorites’ ‘Recently modified’ or ‘Items I own’ instead of the whole damn list 2. set the max return records to 50 or 100 - really, who is going to scroll through more than 50 items in a list? click a group filter or search! 3. disallow search with NULL, or less than 3 characters in the search box… this is not so important if you have added the 50 returned record max 4. fix the recently modified list to actually pull only the last 7 days modified date We have about 3,200 records and implementing some quick and dirty code for the above cut both the navigation times by 80%! we found most of the resource struggle is on the client-side render. but not returning all 3,200 records EVERY time someone logged on also helped on the server side. ---
**Author:** ![eddie4](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/eddie4/32/96_2.png) [@eddie4](https://community.passbolt.com/u/eddie4)\ **Post date:** [July 30, 2018, 8:28am UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/16 "2018-07-30T08:28:34Z")
> Awesome, I talked to the big chief here and we will offer a bounty of 150 euro if it is indeed done this month. How is the coding coming along ? ---
**Author:** ![kevin](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/kevin/32/128_2.png) [@kevin](https://community.passbolt.com/u/kevin)\ **Post date:** [July 30, 2018, 9:30am UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/17 "2018-07-30T09:30:35Z")
Hi @eddie4. Glad to see that you didn’t forget about it. It’s going well! A new release is coming up in the next few days. Stay tuned!! ---
**Author:** ![Nikolay](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/nikolay/32/202_2.png) [@Nikolay](https://community.passbolt.com/u/Nikolay)\ **Post date:** [August 8, 2018, 9:51am UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/18 "2018-08-08T09:51:36Z")
Hi guys, Is this issue fixed already? Thanks ---
**Author:** ![cedric](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/cedric/32/3868_2.png) [@cedric](https://community.passbolt.com/u/cedric)\ **Post date:** [August 8, 2018, 9:58am UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/19 "2018-08-08T09:58:33Z")
Hello @Nikolay, A fix will be release with v2.2.0 this week. Thank you for your patience. ---
**Author:** ![Nikolay](https://yyz1.discourse-cdn.com/flex031/user_avatar/community.passbolt.com/nikolay/32/202_2.png) [@Nikolay](https://community.passbolt.com/u/Nikolay)\ **Post date:** [August 8, 2018, 10:04am UTC](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493/20 "2018-08-08T10:04:44Z")
Thanks @cedric 🙂 this is really a good news! [Next page](https://community.passbolt.com/t/fix-performance-issue-on-large-password-database-2k-4k-passwords/493.md?page=2)