Project

General

Profile

Actions

Task #2247

closed

Check performance for 2000 virtual systems

Added by Vít Švanda over 4 years ago. Updated over 4 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Ondrej Husník
Category:
Provisioning
Target version:
Start date:
05/12/2020
Due date:
% Done:

100%

Estimated time:
Owner:

Files

IdmIdnetityEventLogDetail.png (36.4 KB) IdmIdnetityEventLogDetail.png Ondrej Husník, 05/21/2020 11:38 AM

Related issues

Precedes IdStory Identity Manager - Task #2349: Perform optimizations for 2000 virtual systems in one IdM.NewVít Švanda05/13/202005/13/2020

Actions
Actions #1

Updated by Ondrej Husník over 4 years ago

  • Status changed from New to In Progress
Actions #2

Updated by Ondrej Husník over 4 years ago

Part of this task was to create LRT task able to generate required number of virtual systems and link them evenly with given number of identities. Systems are linked to identities via generated roles. There is the choice to generate either same number of roles as systems or as identities.

Next part was to test huge amount of systems. The testing scenario was: 2000 systems, 2000 roles, 1 identity.
This test case as a whole didn't finish in reasonable time. The generating of the set number of entities took approx. 4 hours. As the longest part seemed to be the creation of Identity-Role bound. The speed of creating new bounds was getting worse in time after 1000 bounds - 1 identity-role per 6s, 1900 1 per 17s.
After finishing LRT generating test entities, all triggered events kept being executed. Duration of some operations is summarized in the table below. Significant performance drop is apparent in case of operations applied on IdmIdentity. Added picture shows event log detail.

Duration execution of chosen entities - time per 1 entity (<1s means beyond resolution))
Number
Entity
100 800 900 925 1450 2000 Info
IdmIdentity <1s <1s <15s ~2h n/a n/a provisioning op. acc:identity-save-processor core:identity-automatic-role-processor
IdmRole - - - - - < 1s
IdmIdentityContract - - - - < 1s n/a
IdmIdentityRole - - - - < 1s n/a
SysSystem - - - - - < 1s
SysRoleSystem - - - - - < 1s

Actions #3

Updated by Ondrej Husník over 4 years ago

  • % Done changed from 0 to 90

VS generator created in this task is now able to accept as parameters arbitrary number of systems, identities and roles.

Please could you provide me a feedback of the implemented task executor?

https://github.com/bcvsolutions/CzechIdMng/commit/79ea3ba659bed234788f4ce09c34967d11780223
https://wiki.czechidm.com/devel/documentation/application_configuration/dev/scheduled_tasks/task-scheduler

Actions #4

Updated by Ondrej Husník over 4 years ago

  • Status changed from In Progress to Needs feedback
  • Assignee changed from Ondrej Husník to Vít Švanda
Actions #5

Updated by Vít Švanda over 4 years ago

  • Precedes Task #2349: Perform optimizations for 2000 virtual systems in one IdM. added
Actions #6

Updated by Vít Švanda over 4 years ago

Optimization will be perform in the #2349.

Actions #7

Updated by Vít Švanda over 4 years ago

  • Status changed from Needs feedback to Resolved
  • Assignee changed from Vít Švanda to Ondrej Husník
  • % Done changed from 90 to 100

I did reivew and tested it. Works correctly, nice code. Thanks for that.

I made some minor changes:

https://github.com/bcvsolutions/CzechIdMng/commit/44a890f987b789efa8e05935d73dbb6c461b0a7f

Actions #8

Updated by Radek Tomiška over 4 years ago

  • Status changed from Resolved to Closed
Actions

Also available in: Atom PDF