the tool Find Possible Duplicate People is slow to merge people

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

the tool Find Possible Duplicate People is slow to merge people

Eric Doutreleau
Hi

i m using gramps 4.2.5 on fedora25 and i have the following problem

i m created a database from various gedcom for several cousin.

i have imported all the data and then i have numerous people merge to do.

the database is around 10k people

if i merge people from the people list view the merge is very very fast
less than a quarter of second.

but if i use the tool Find Possible Duplicate People it s very slow more
than 15 seconds after i click ok in the compare view.

Has someone already seen that?


------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/intel
_______________________________________________
Gramps-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gramps-users
https://gramps-project.org
Reply | Threaded
Open this post in threaded view
|

Re: the tool Find Possible Duplicate People is slow to merge people

Eric Doutreleau
Hi to all

i have strace the process of merging in the person view and with the
finddupes tool

for the findduppes tool  i got this

---------------------------------

1482409135.343900 pread64(23,
"\20\0\0\0\202u\221\0\324\0\0\0\10\7\0\0\t\7\0\0002\0,\1\1\5\300\17l\17,\17"...,
4096, 868352) = 4096
1482409135.345290 pwrite64(11,
"\367~+\0008\0\0\0Ej\342\3357\0\0\0R\0\0\200\0\0\0\0\0\0\0\0\33\0\0\0"...,
13038, 2850595) = 13038
1482409135.345504 fdatasync(11)         = 0
1482409136.692635 recvmsg(3, {msg_name=NULL, msg_namelen=0,
msg_iov=[{iov_base="\241
-p\7\340!\0\320\1\0\0r\0\0\0\0\0\0\0\241u\0\0\33A\0\0\320\7\0\0"...,
iov_len=4096}], msg_iovlen=1, msg_controllen=0, msg_flags=0}, 0) = 4096
1482409136.692737 recvfrom(3,
"\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0"...,
64, 0, NULL, NULL) = 64
1482409136.692793 recvmsg(3, {msg_name=NULL, msg_namelen=0,
msg_iov=[{iov_base="#\203-p\32\0\0\0\6\0\2\0\343\253\331\0\0\0\0\0\5\1\0\0\1\1
\0\0\0\0\0"..., iov_len=4096}], msg_iovlen=1, msg_controllen=0,
msg_flags=0}, 0) = 348
1482409136.692816 recvmsg(3, {msg_namelen=0}, 0) = -1 EAGAIN (Resource
temporarily unavailable)
1482409136.692839 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.692871 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.692990 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693019 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693087 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693117 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693174 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693203 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693262 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693292 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693368 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693408 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693630 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693660 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693809 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693832 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693878 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693900 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693950 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.693972 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409136.694115 write(4, "\1\0\0\0\0\0\0\0", 8) = 8
1482409136.699054 pwrite64(11,
"\345\261+\0^\0\0\0JP\354\266\31\0\0\0S\0\0\200\0\0\0\0\0\0\0\0\26\0\0\0"...,
138, 2863633) = 138
1482409159.211597 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 1 ([{fd=4, revents=POLLIN}])
1482409159.211671 read(4, "\1\0\0\0\0\0\0\0", 16) = 8
1482409159.211743 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409159.211763 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409159.211781 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
-------------------------------------------------
the file descriptor 11 is
/home/grocanar/.gramps/grampsdb/58596b52/log.0000000030

then it seems that just after do the merge gramps is frozen during 23
seconds.

with the merge done in the person view i got at the same point.


---------------------------------------------------------
1482409684.516616 pread64(38,
"\30\0\0\0q\350s\0\34\17\0\0\23\17\0\0\27\17\0\0,\0\234\7\1\5\340\17\234\17\340\17"...,
4096, 15843328) = 4096
1482409684.517162 pread64(27,
"\35\0\0\0\263\300[\0008\0\0\0\0\0\0\0\0\0\0\0\204\0J\7\0\r\372\17\336\17\330\17"...,
4096, 229376) = 4096
1482409684.517649 pread64(23,
"\32\0\0\0\34``\0\211\32\0\0\210\32\0\0\213\32\0\0\32\0,\10\1\5\274\17d\17$\17"...,
4096, 27824128) = 4096
1482409684.518187 pwrite64(11,
"\2024,\0008\0\0\0\216S\265o7\0\0\0Z\0\0\200\0\0\0\0\0\0\0\0\33\0\0\0"...,
8747, 2897070) = 8747
1482409684.518270 fdatasync(11)         = 0
1482409684.519457 clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=1167,
tv_nsec=970873023}) = 0
1482409684.519912 clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=1167,
tv_nsec=971277660}) = 0
1482409684.520916 clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=1167,
tv_nsec=972237072}) = 0
1482409684.520987 clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=1167,
tv_nsec=972271026}) = 0
1482409684.521938 clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=1167,
tv_nsec=973178282}) = 0
1482409684.522006 clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=1167,
tv_nsec=973209445}) = 0
1482409684.522286 clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=1167,
tv_nsec=973453620}) = 0
1482409684.523253 clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=1167,
tv_nsec=974373984}) = 0
1482409684.526564 clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=1167,
tv_nsec=977619341}) = 0
1482409684.526613 clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=1167,
tv_nsec=977632287}) = 0
1482409684.527555 clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=1167,
tv_nsec=978530214}) = 0
1482409684.527621 clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=1167,
tv_nsec=978560248}) = 0
1482409684.527679 clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=1167,
tv_nsec=978581468}) = 0
1482409684.536062 recvmsg(3, {msg_name=NULL, msg_namelen=0,
msg_iov=[{iov_base="\241
g\326h\255\"\0\317\1\0\0\300\0\0\0\0\0\0\0\210T\363r\3\0\0\0\0\0\0\0"...,
iov_len=4096}], msg_iovlen=1, msg_controllen=0, msg_flags=0}, 0) = 64
1482409684.536139 recvmsg(3, {msg_namelen=0}, 0) = -1 EAGAIN (Resource
temporarily unavailable)
1482409684.536173 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409684.536204 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409684.536241 recvmsg(3, {msg_namelen=0}, 0) = -1 EAGAIN (Resource
temporarily unavailable)
1482409684.536266 recvmsg(3, {msg_namelen=0}, 0) = -1 EAGAIN (Resource
temporarily unavailable)
1482409684.536283 poll([{fd=3, events=POLLIN}, {fd=4, events=POLLIN},
{fd=5, events=POLLIN}], 3, 0) = 0 (Timeout)
1482409684.536305 recvmsg(3, {msg_namelen=0}, 0) = -1 EAGAIN (Resource
temporarily unavailable)
-----------------------------

There s no delay.

Can it be related to gtk?

Le 21/12/2016 à 13:19, Eric Doutreleau a écrit :

> Hi
>
> i m using gramps 4.2.5 on fedora25 and i have the following problem
>
> i m created a database from various gedcom for several cousin.
>
> i have imported all the data and then i have numerous people merge to do.
>
> the database is around 10k people
>
> if i merge people from the people list view the merge is very very fast
> less than a quarter of second.
>
> but if i use the tool Find Possible Duplicate People it s very slow more
> than 15 seconds after i click ok in the compare view.
>
> Has someone already seen that?
>
>
> ------------------------------------------------------------------------------
> Developer Access Program for Intel Xeon Phi Processors
> Access to Intel Xeon Phi processor-based developer platforms.
> With one year of Intel Parallel Studio XE.
> Training and support from Colfax.
> Order your platform today.http://sdm.link/intel
> _______________________________________________
> Gramps-users mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/gramps-users
> https://gramps-project.org


------------------------------------------------------------------------------
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today.http://sdm.link/intel
_______________________________________________
Gramps-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gramps-users
https://gramps-project.org