Project

General

Profile

Actions

Task #657

closed

Synchronization transform to DTOs

Added by Ondřej Kopr over 7 years ago. Updated about 7 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Ondřej Kopr
Category:
Synchronization
Target version:
Start date:
08/17/2017
Due date:
% Done:

100%

Estimated time:
Owner:

Description

Transform
  • SyncActionLog,
  • SyncConfig,
  • SyncItemLog,
  • SyncLog.

to DTOs. Check tests and FE.


Related issues

Related to IdStory Identity Manager - Task #663: Schema transform to DTOClosedOndřej Kopr08/24/2017

Actions
Related to IdStory Identity Manager - Task #663: Schema transform to DTOClosedOndřej Kopr08/24/2017

Actions
Related to IdStory Identity Manager - Task #675: Role system transform to DTOClosedOndřej Kopr08/30/2017

Actions
Related to IdStory Identity Manager - Task #676: AccAccount transform to DTOClosedOndřej Kopr08/30/2017

Actions
Related to IdStory Identity Manager - Task #685: Transfrom SysSystem to DTOClosedOndřej Kopr09/01/2017

Actions
Related to IdStory Identity Manager - Task #694: Provisioning transform to DTOClosedOndřej Kopr09/08/2017

Actions
Actions #1

Updated by Ondřej Kopr over 7 years ago

  • % Done changed from 0 to 60

Refactor synchronization to DTO was completed. All tests are passed. Now i will start with FE testing.

Actions #3

Updated by Ondřej Kopr over 7 years ago

  • % Done changed from 60 to 80

Finished with refactor synchronization to DTO and tests.

commits:

from FE check different behavior. Now i test synchronization with lots of data.

Actions #4

Updated by Ondřej Kopr over 7 years ago

merged into develop

Actions #5

Updated by Ondřej Kopr over 7 years ago

Actions #6

Updated by Ondřej Kopr over 7 years ago

  • % Done changed from 80 to 90

I did tests with big data:

identities synchronization, username (transform script with FOR cycle), first name, last name, description and email.
Synchronization start about 16:30 after night it was synchronized ~164.000 identities - 9:00 (16,5 hours). Memory usage: 6.7GB (when synchronization start it was about 6GB).
Synchronization still continuing.

Before start synchronization i was explored bug (after transform mapping to dtos), system copy not working.

Actions #7

Updated by Ondřej Kopr over 7 years ago

another test result:
first 100 of identities - 0:21 min
last 100 of identities - 2:40 min

slowdown is about 120.000 records, 100.000 records lasting 5h

Actions #8

Updated by Ondřej Kopr over 7 years ago

  • Status changed from In Progress to Needs feedback
  • Assignee changed from Ondřej Kopr to Vít Švanda

fix issue with transform script checkbox and duplicate copy
commit: https://github.com/bcvsolutions/CzechIdMng/commit/791dc41903cc02249cfdca04eb4695208ec2ccfe

also add test for duplicate system check synchronization
commit: https://github.com/bcvsolutions/CzechIdMng/commit/0763dee8fc27f45d4b80a67e44ed3ecd0ca9e702

please Vitek could you make a review? Thank you.

Actions #9

Updated by Ondřej Kopr over 7 years ago

  • Related to Task #663: Schema transform to DTO added
Actions #10

Updated by Ondřej Kopr over 7 years ago

  • Related to Task #663: Schema transform to DTO added
Actions #11

Updated by Ondřej Kopr over 7 years ago

  • Related to Task #675: Role system transform to DTO added
Actions #12

Updated by Ondřej Kopr over 7 years ago

  • Related to Task #676: AccAccount transform to DTO added
Actions #13

Updated by Ondřej Kopr over 7 years ago

  • Related to Task #685: Transfrom SysSystem to DTO added
Actions #14

Updated by Ondřej Kopr over 7 years ago

  • Related to Task #694: Provisioning transform to DTO added
Actions #15

Updated by Vít Švanda about 7 years ago

  • Status changed from Needs feedback to Resolved
  • Assignee changed from Vít Švanda to Ondřej Kopr
  • % Done changed from 90 to 100

I did review, everythings works fine. I did few minor improvements (in commit https://github.com/bcvsolutions/CzechIdMng/commit/579a0985f1a1f667f6b332659e97b1399e5e7973).
Thanks for that.

Actions #16

Updated by Radek Tomiška about 7 years ago

  • Status changed from Resolved to Closed
Actions

Also available in: Atom PDF