Project

General

Profile

Actions

Task #1032

closed

Profiling CzechIdM (synchronization, recalculation, hr process)

Added by Ondřej Kopr about 6 years ago. Updated about 6 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Ondřej Kopr
Category:
Profiling
Target version:
Start date:
03/16/2018
Due date:
% Done:

100%

Estimated time:
Owner:

Description

results from profiling

All these test was done in my local enviroment with
  • 20k identities,
  • 50k contracts,
  • 400 automatic roles by attribute,
  • 550 roles,
  • 1k tree nodes,
  • spring profile: dev (logging to trace),
  • profiling on.

Related issues

Related to IdStory Identity Manager - Task #1034: Remove role request from automatic rolesClosedOndřej Kopr03/16/2018

Actions
Related to IdStory Identity Manager - Task #1031: Skip recalculation for automatic roles in HR processClosedOndřej Kopr03/15/2018

Actions
Actions #1

Updated by Ondřej Kopr about 6 years ago

Synchronization contracts with skip recalculation (851 updated entities, 1900 created entities, ~60 minutes)

  • eu.bcvsolutions.idm.ic.service.impl.DefaultIcConnectorFacade.search 99%
  • eu.bcvsolutions.idm.ic.connid.service.impl.ConnIdIcConnectorService$2.handle 99%
  • eu.bcvsolutions.idm.acc.service.impl.AbstractSynchronizationExecutor$DefaultResultHandler.handle 99%
  • eu.bcvsolutions.idm.acc.service.impl.DefaultSysSyncActionLogService.find 10%
  • eu.bcvsolutions.idm.core.model.service.impl.DefaultEntityEventManager.process 60%
  • eu.bcvsolutions.idm.acc.event.processor.synchronization.SynchronizationItemProcessor.process 59%
  • eu.bcvsolutions.idm.acc.event.processor.synchronization.SynchronizationItemProcessor.process 59%
  • eu.bcvsolutions.idm.acc.service.impl.DefaultSynchronizationService.invoke 51%
  • eu.bcvsolutions.idm.core.model.service.impl.DefaultIdmIdentityContractService.publish 17%
  • eu.bcvsolutions.idm.acc.service.impl.DefaultProvisioningService.doProvisioning 17%
  • eu.bcvsolutions.idm.acc.service.impl.DefaultSysSystemAttributeMappingService.getValueByMappedAttribute 14%
  • eu.bcvsolutions.idm.core.eav.service.impl.DefaultFormService.getDefinition 3%
  • eu.bcvsolutions.idm.core.eav.service.impl.DefaultFormService.saveValues 3%
  • eu.bcvsolutions.idm.core.model.service.impl.DefaultEntityEventManager.process 6%
  • eu.bcvsolutions.idm.core.model.repository.listener.IdmAuditListener.entityChanged 7%
  • eu.bcvsolutions.idm.acc.service.impl.DefaultSysSyncActionLogService.saveAll 7%
  • eu.bcvsolutions.idm.acc.service.impl.DefaultSysSyncConfigService.save 17%
  • eu.bcvsolutions.idm.acc.service.impl.DefaultSysSyncLogService.get 7%
Actions #2

Updated by Ondřej Kopr about 6 years ago

  • Description updated (diff)
Actions #3

Updated by Ondřej Kopr about 6 years ago

Recalculation automatic role by attribute with role request (2100 role request created == 2100 new identity role, 18 minutes)

  • eu.bcvsolutions.idm.core.scheduler.task.impl.ProcessAllAutomaticRoleByAttributeTaskExecutor.process() 100%
  • eu.bcvsolutions.idm.core.scheduler.task.impl.ProcessAllAutomaticRoleByAttributeTaskExecutor.processAutomaticRoleForContract 99.9%
  • eu.bcvsolutions.idm.core.model.service.impl.DefaultIdmAutomaticRoleAttributeService.getContractsForAutomaticRole 4%
  • eu.bcvsolutions.idm.core.model.service.impl.DefaultIdmAutomaticRoleAttributeService.prepareAddAutomaticRoles 13%
  • eu.bcvsolutions.idm.core.model.service.impl.DefaultIdmRoleRequestService.startRequestInternal 78%
  • eu.bcvsolutions.idm.core.model.service.impl.DefaultIdmConceptRoleRequestService.findAllByRoleRequest 7%
  • eu.bcvsolutions.idm.core.model.event.processor.role.RoleRequestRealizationProcessor.process 57%
  • eu.bcvsolutions.idm.core.model.service.impl.DefaultIdmRoleRequestService.executeRequest 57%
  • eu.bcvsolutions.idm.core.model.service.impl.DefaultIdmIdentityRoleService.save 47%
  • eu.bcvsolutions.idm.core.model.repository.listener.IdmAuditListener.entityChanged 5%
  • eu.bcvsolutions.idm.core.scheduler.service.impl.DefaultIdmLongRunningTaskService.get 2%
  • eu.bcvsolutions.idm.core.scheduler.service.impl.DefaultIdmLongRunningTaskService.updateState1%
Actions #4

Updated by Ondřej Kopr about 6 years ago

  • Description updated (diff)

Recalculation automatic role by attribute without role request (2800 new identity role, 17 minutes)

  • eu.bcvsolutions.idm.core.scheduler.task.impl.ProcessAllAutomaticRoleByAttributeTaskExecutor.process() 100%
  • eu.bcvsolutions.idm.core.model.service.impl.DefaultIdmAutomaticRoleAttributeService.getContractsForAutomaticRole 7%
  • eu.bcvsolutions.idm.core.model.service.impl.DefaultIdmIdentityContractService.get 4%
  • eu.bcvsolutions.idm.core.scheduler.task.impl.ProcessAllAutomaticRoleByAttributeTaskExecutor.addRoleToContract 86%
  • eu.bcvsolutions.idm.core.model.service.impl.DefaultIdmIdentityRoleService.save 86%

Recalculation automatic role by attribute without role request and skip processor identity-role-add-authorities-processor and identity-role-delete-authorities-processor (!11800! new identity role, 17 minutes)

  • eu.bcvsolutions.idm.core.scheduler.task.impl.ProcessAllAutomaticRoleByAttributeTaskExecutor.process() 100%
  • eu.bcvsolutions.idm.core.model.service.impl.DefaultIdmAutomaticRoleAttributeService.getContractsForAutomaticRole 7%
  • eu.bcvsolutions.idm.core.model.service.impl.DefaultIdmIdentityContractService.get 4%
  • eu.bcvsolutions.idm.core.scheduler.service.impl.DefaultIdmLongRunningTaskService.updateState 4%
  • eu.bcvsolutions.idm.core.scheduler.task.impl.ProcessAllAutomaticRoleByAttributeTaskExecutor.addRoleToContract 75%
  • eu.bcvsolutions.idm.core.model.service.impl.DefaultIdmIdentityRoleService.save 75%
Actions #5

Updated by Ondřej Kopr about 6 years ago

  • Related to Task #1034: Remove role request from automatic roles added
Actions #6

Updated by Ondřej Kopr about 6 years ago

  • % Done changed from 0 to 90

In both cases I wait (or try it) until synchronization correctly ended with HR process and automatic role recalculation (hr process and recalculation is part of synchronization time).

Synchronization on version 7.8.3 with enabled automatic roles and hr process, 1k created contracts
  • Synchronization + HR process + Automatic role recalculation didn't end after weekend,
  • HR process - enable active contract 167 / 728 (problem with recalculating roles)

Synchronization on version 7.8.4-SNAPSHOT with enabled automatic roles and hr process, 1k created contracts
  • Synchronization 1k contracts/11minutes,
  • HrEnableContractProcess 768, 3 minutes,
  • automatic role recalculation 200 roles, 36k newly added identity roles 2.5h.

Actions #7

Updated by Ondřej Kopr about 6 years ago

  • Related to Task #1031: Skip recalculation for automatic roles in HR process added
Actions #8

Updated by Ondřej Kopr about 6 years ago

  • Target version set to Garnet (7.8.5)
Actions #9

Updated by Ondřej Kopr about 6 years ago

  • Status changed from New to Resolved
  • % Done changed from 90 to 100

In version 7.8.5 was implemented skip automatic role recalculation and provisioning skip for HR process, for more info please see tickets #1031 and #1034

Actions #10

Updated by Ondřej Kopr about 6 years ago

  • Status changed from Resolved to Closed
Actions

Also available in: Atom PDF