Quantcast

Reading GED(com) Files

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Reading GED(com) Files

foberle
I'm not using the bug tracker, since it is quite possible what I am reporting is intentional, although this might be considered an enhancement request.

To get the basics out of the way, I recently decided to attempt a move from Windows to Ubuntu, and loaded Ubuntu 12.04 onto a laptop to "test the waters". So far, I've loaded several replacement programs for those I use quite often in Windows. The variety of Linux genealogy programs isn't as extensive as those for Windows, but Gramps seemed to have been given high marks by a number of users. Although there are quite a few fairly negative reviews out there, most seem to have been written by folks who didn't seem to be very familiar with genealogy (e.g. one wondered what LDS stood for, so obviously hadn't done very much research), so I decided to give it a shot.

In its current state, my GEDCOM file contains 4,822 names, 1,477 families, and 179 common sources in 18 Repositories.

I downloaded and installed Gramps 3.3.1-1 through the Ubuntu Software Center (so not the very latest, but likely stable), and set up a new, empty, database. All this took a reasonable amount of time and went well.

I then attempted to import my .ged file into the new Gramps database. Based on many comments I had read on the internet, I expected that this might take a considerable amount of time, but it proceeded fairly quickly until it encountered (as I determined when troubleshooting) a blank line in the gedcom file, at which point it aborted with a "File appears to be truncated" message. (shortly thereafter, I also received a message that Ubuntu had experienced an internal error but, since that seems to be a fairly common occurrence, I have no idea whether or not it was related.)

The gedcom file had blank lines between the various sections which, as far as I can determine, is quite legal, and the other programs I've used don't seem troubled by this. Anyway, I manually edited the file to remove the blank lines and attempted to re-import the file. This time, things appeared to go quite smoothly, but this was, it turns out, somewhat misleading.

The first thing I noticed was that the initial person in the gedcom file, who had the ID Number 1 (0 @I1@ INDI) was listed twice - once as ID Number 0 and once as ID Number 1. Annoying, but it seems like it would be quite easy to just delete one of them.

The second, and much more disturbing, thing I noticed was that no family information seemed to have been loaded by Gramps. Everyone in the file was apparently an orphan.

Looking about, I came across a suggestion that perhaps a "Check and Repair Database" was in order. Not a good sign, but I proceeded to do that. In the massive listing of accomplishments that resulted, Gramps reported that, during the cleanup, it had detected and deleted a long list of family connections that seemed to be an inclusive list of each connection in the FAM section of my gedcom file.

My conclusion is that, although Gramps "read" the connections just fine, it didn't wish to acknowledge them. Upon further examination, it appears that Gramps may require that family connections must be specified within each INDI section of the ged file. I have seen many programs that include this information in that manner, but I have yet to encounter one that REQUIRED it, and most will, like Gramps apparently did, read the FAM section records, but go ahead and build the family trees/connections from that.

Since I'm not about to manually reconstruct all of the family connections, I was unable to take a look at any of the charts or reports available, and it didn't seem worthwhile to explore any of the additional "gramplets" that seem to be available.

Does anyone have any suggestions as to how I might proceed?

Thanks.

----------------------------
Frank Oberle
foberle @ enteract.com

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Gramps-bugs mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gramps-bugs
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Reading GED(com) Files

Peter Landgren
What program did you use to create the GEDCOM fil?

/Peter

[hidden email] skrev 2012-08-21 18:13:

> I'm not using the bug tracker, since it is quite possible what I am reporting is intentional, although this might be considered an enhancement request.
>
> To get the basics out of the way, I recently decided to attempt a move from Windows to Ubuntu, and loaded Ubuntu 12.04 onto a laptop to "test the waters". So far, I've loaded several replacement programs for those I use quite often in Windows. The variety of Linux genealogy programs isn't as extensive as those for Windows, but Gramps seemed to have been given high marks by a number of users. Although there are quite a few fairly negative reviews out there, most seem to have been written by folks who didn't seem to be very familiar with genealogy (e.g. one wondered what LDS stood for, so obviously hadn't done very much research), so I decided to give it a shot.
>
> In its current state, my GEDCOM file contains 4,822 names, 1,477 families, and 179 common sources in 18 Repositories.
>
> I downloaded and installed Gramps 3.3.1-1 through the Ubuntu Software Center (so not the very latest, but likely stable), and set up a new, empty, database. All this took a reasonable amount of time and went well.
>
> I then attempted to import my .ged file into the new Gramps database. Based on many comments I had read on the internet, I expected that this might take a considerable amount of time, but it proceeded fairly quickly until it encountered (as I determined when troubleshooting) a blank line in the gedcom file, at which point it aborted with a "File appears to be truncated" message. (shortly thereafter, I also received a message that Ubuntu had experienced an internal error but, since that seems to be a fairly common occurrence, I have no idea whether or not it was related.)
>
> The gedcom file had blank lines between the various sections which, as far as I can determine, is quite legal, and the other programs I've used don't seem troubled by this. Anyway, I manually edited the file to remove the blank lines and attempted to re-import the file. This time, things appeared to go quite smoothly, but this was, it turns out, somewhat misleading.
>
> The first thing I noticed was that the initial person in the gedcom file, who had the ID Number 1 (0 @I1@ INDI) was listed twice - once as ID Number 0 and once as ID Number 1. Annoying, but it seems like it would be quite easy to just delete one of them.
>
> The second, and much more disturbing, thing I noticed was that no family information seemed to have been loaded by Gramps. Everyone in the file was apparently an orphan.
>
> Looking about, I came across a suggestion that perhaps a "Check and Repair Database" was in order. Not a good sign, but I proceeded to do that. In the massive listing of accomplishments that resulted, Gramps reported that, during the cleanup, it had detected and deleted a long list of family connections that seemed to be an inclusive list of each connection in the FAM section of my gedcom file.
>
> My conclusion is that, although Gramps "read" the connections just fine, it didn't wish to acknowledge them. Upon further examination, it appears that Gramps may require that family connections must be specified within each INDI section of the ged file. I have seen many programs that include this information in that manner, but I have yet to encounter one that REQUIRED it, and most will, like Gramps apparently did, read the FAM section records, but go ahead and build the family trees/connections from that.
>
> Since I'm not about to manually reconstruct all of the family connections, I was unable to take a look at any of the charts or reports available, and it didn't seem worthwhile to explore any of the additional "gramplets" that seem to be available.
>
> Does anyone have any suggestions as to how I might proceed?
>
> Thanks.
>
> ----------------------------
> Frank Oberle
> foberle @ enteract.com
>
> ------------------------------------------------------------------------------
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> _______________________________________________
> Gramps-bugs mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/gramps-bugs
>


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Gramps-bugs mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gramps-bugs
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Reading GED(com) Files

Tim Lyons
Administrator
In reply to this post by foberle
We discussed what is probably the same question here:
http://gramps.1791082.n4.nabble.com/Why-does-check-py-remove-rather-than-fix-td4655799.html

The GEDCOM import has been improved in 3.4.0, and it is possible that the problem you encountered has been fixed.

I know it is annoying to be told to try the newer version, because the problem _may_ be fixed there, but in this case, I think it would be worthwhile. Anyway, if the problem is ever going to be fixed, it will not now be fixed in 3.3.x.

I am not sure why you found a duplication of the first individual, but the allocation of ID Numbers has also been improved, so this problem may also have gone away.

I too would be interested to know which tool was used to export the GEDCOM.

Regards,
Tim.
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Reading GED(com) Files

Benny Malengier
Is it not possible you imported the gedcom the second time in the family tree you did the first attempt for?

As the first import crashed on the empty lines, the families of the people would never have been loaded, and everybody would have incomplete families.
Your second import would duplicate people.

So, if this was the case, delete the family tree, make a new one, and do the import in this empty famtree

Benny

2012/8/22 Tim Lyons <[hidden email]>
We discussed what is probably the same question here:
http://gramps.1791082.n4.nabble.com/Why-does-check-py-remove-rather-than-fix-td4655799.html

The GEDCOM import has been improved in 3.4.0, and it is possible that the
problem you encountered has been fixed.

I know it is annoying to be told to try the newer version, because the
problem _may_ be fixed there, but in this case, I think it would be
worthwhile. Anyway, if the problem is ever going to be fixed, it will not
now be fixed in 3.3.x.

I am not sure why you found a duplication of the first individual, but the
allocation of ID Numbers has also been improved, so this problem may also
have gone away.

I too would be interested to know which tool was used to export the GEDCOM.

Regards,
Tim.



--
View this message in context: http://gramps.1791082.n4.nabble.com/Reading-GED-com-Files-tp4656048p4656054.html
Sent from the gramps-bugs mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Gramps-bugs mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gramps-bugs


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Gramps-bugs mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gramps-bugs
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Reading GED(com) Files

Tim Lyons
Administrator
In reply to this post by Tim Lyons
See also http://gramps.1791082.n4.nabble.com/Why-does-check-py-remove-rather-than-fix-td4655799.html


Fixed in gramps34/trunk revisions 20438/20439. Fixed in GEDCOM import, importxml and Check and repair. (Also minor fixes for improved diagnostics when importxml just completely fails and for exportxml illegal characters in mime_type).

Tested using the supplied file (gramps-1.ged) and also xml export and import of Tools->Debug->Generate Testcases for Persons and Families...

Frank, If you don't want to wait for Gramps 3.4.2 to be released, you could replace libgedcom.py on your computer with the one in http://gramps.svn.sourceforge.net/viewvc/gramps/branches/maintenance/gramps34/src/plugins/lib/libgedcom.py?revision=20438&pathrev=20438. Email me privately if you need more advice to how to do this.

Regards,
Tim.
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Reading GED(com) Files

Tim Lyons
Administrator
Sorry, I forgot to say that this is fixed under bug 6061:
http://www.gramps-project.org/bugs/view.php?id=6061
Loading...