Restore Gramps session from recovered files (Photorec)

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

Restore Gramps session from recovered files (Photorec)

otyugh
Hey,
I'm in this case of an old person working with Gramps that did not
thought of making a backup or anything and got his hard drive failing
him (had to happen).

I tried the "clean way" with testdisk, didn't work, had to use
photoreq to recover a few stuff (50 000 files without name, yay). Still,
now, I wonder if I can recover anything from this mess regarding Gramps
or if nothing can be done.

I'm an experienced user (just not familiar with Gramps), I'm not affraid
trying, but if it's not possible, I wish not to lose more time on the
issue ! Looking for your insight.

Regards.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Gramps-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gramps-users
https://gramps-project.org
Reply | Threaded
Open this post in threaded view
|

Re: Restore Gramps session from recovered files (Photorec)

Ron Johnson
This is more than just a Gramps recovery, I presume?

On 05/01/2017 04:48 PM, otyugh wrote:

> Hey,
> I'm in this case of an old person working with Gramps that did not
> thought of making a backup or anything and got his hard drive failing
> him (had to happen).
>
> I tried the "clean way" with testdisk, didn't work, had to use
> photoreq to recover a few stuff (50 000 files without name, yay). Still,
> now, I wonder if I can recover anything from this mess regarding Gramps
> or if nothing can be done.
>
> I'm an experienced user (just not familiar with Gramps), I'm not affraid
> trying, but if it's not possible, I wish not to lose more time on the
> issue ! Looking for your insight.
>
> Regards.

--
World Peace Through Nuclear Pacification


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Gramps-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gramps-users
https://gramps-project.org
Reply | Threaded
Open this post in threaded view
|

Re: Restore Gramps session from recovered files (Photorec)

Peter Merchant
You didn't mention what operating system, but if it is a Microsoft one,
have you tried Recuva?

Peter M.
On 02/05/17 02:13, Ron Johnson wrote:

> This is more than just a Gramps recovery, I presume?
>
> On 05/01/2017 04:48 PM, otyugh wrote:
>> Hey,
>> I'm in this case of an old person working with Gramps that did not
>> thought of making a backup or anything and got his hard drive failing
>> him (had to happen).
>>
>> I tried the "clean way" with testdisk, didn't work, had to use
>> photoreq to recover a few stuff (50 000 files without name, yay). Still,
>> now, I wonder if I can recover anything from this mess regarding Gramps
>> or if nothing can be done.
>>
>> I'm an experienced user (just not familiar with Gramps), I'm not affraid
>> trying, but if it's not possible, I wish not to lose more time on the
>> issue ! Looking for your insight.
>>
>> Regards.



------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Gramps-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gramps-users
https://gramps-project.org
Reply | Threaded
Open this post in threaded view
|

Re: Restore Gramps session from recovered files (Photorec)

otyugh
In reply to this post by Ron Johnson
Is there any string I could look for to identify the 1-2 files that
could restore the "big part" of what he did on gramps ? I have no idea
how Gramps data works.

>You didn't mention what operating system, but if it is a Microsoft
>one, have you tried Recuva?

GNU/Linux, Ubuntu, ext4. Does recuva handle ext4 ?

I dumped everything in a raw image, I can still try things if you know
any other way.


> This is more than just a Gramps recovery, I presume?
The other stuff are not much of a problem.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Gramps-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gramps-users
https://gramps-project.org
Reply | Threaded
Open this post in threaded view
|

Re: Restore Gramps session from recovered files (Photorec)

Ron Johnson
In reply to this post by Ron Johnson
There are BSDDB files, and plenty of xml files, so "file" should help.  
Unfortunately, there are a *lot* of database files.

$ dir .gramps
total 104
-rw-rw-r-- 1 ron ron  8164 2016-06-06 10:11:38 DetailedDescendantBook.xml
-rw-rw-r-- 1 ron ron  2902 2015-12-12 09:36:00 books.xml
-rw-rw-r-- 1 ron ron  5143 2015-08-11 10:15:32 det_ancestor_report.xml
-rw-rw-r-- 1 ron ron  5168 2016-06-06 09:52:38 det_descendant_report.xml
drwxrwxr-x 2 ron ron     6 2015-01-21 16:54:47 env/
-rw-rw-r-- 1 ron ron  4687 2015-12-28 13:35:03 family_descend_chart.xml
drwxrwxr-x 3 ron ron  4096 2015-01-21 21:24:33 gramps40/
drwxrwxr-x 3 ron ron  4096 2015-08-06 12:28:41 gramps41/
drwxrwxr-x 3 ron ron  4096 2017-04-02 23:56:02 gramps42/
drwxrwxr-x 9 ron ron   118 2017-04-10 17:18:38 grampsdb/
drwxr-xr-x 3 ron ron    27 2015-07-24 18:55:12 maps/
-rw-rw-r-- 1 ron ron  1159 2017-04-27 12:01:06 recent-files-gramps.xml
-rw-rw-r-- 1 ron ron 47228 2017-04-26 19:52:50 report_options.xml
drwxrwxr-x 2 ron ron     6 2015-01-21 16:54:47 temp/
drwxrwxr-x 4 ron ron    33 2015-01-21 16:54:47 thumb/
-rw-rw-r-- 1 ron ron  1009 2017-04-07 23:35:32 tool_options.xml

$ dir .gramps/gramps42
total 248
-rw-r--r--  1 ron ron 12288 2017-04-02 23:56:06 .custom_filters.xml.swp
-rw-rw-r--  1 ron ron    68 2016-08-19 17:50:11
Ancestry_TimelinePedigreeView.ini
-rw-rw-r--  1 ron ron   119 2016-08-19 17:50:11
Ancestry_TimelinePedigreeView_bottombar.ini
-rw-rw-r--  1 ron ron   119 2016-08-19 17:50:11
Ancestry_TimelinePedigreeView_sidebar.ini
-rw-rw-r--  1 ron ron   266 2016-12-13 23:43:57 Ancestry_fanchartdescview.ini
-rw-rw-r--  1 ron ron   119 2016-12-13 23:43:57
Ancestry_fanchartdescview_bottombar.ini
-rw-rw-r--  1 ron ron   275 2016-12-13 23:43:57
Ancestry_fanchartdescview_sidebar.ini
-rw-rw-r--  1 ron ron   266 2016-02-16 17:04:24 Ancestry_fanchartview.ini
-rw-rw-r--  1 ron ron   237 2017-04-07 21:38:15 Ancestry_graphview.ini
-rw-rw-r--  1 ron ron   119 2017-04-07 21:38:15 Ancestry_graphview_bottombar.ini
-rw-rw-r--  1 ron ron   120 2017-04-07 21:38:15 Ancestry_graphview_sidebar.ini
-rw-rw-r--  1 ron ron   221 2017-04-26 19:19:16 Ancestry_pedigreeview.ini
-rw-rw-r--  1 ron ron   119 2017-04-26 19:19:16
Ancestry_pedigreeview_bottombar.ini
-rw-rw-r--  1 ron ron   119 2017-04-26 19:19:16
Ancestry_pedigreeview_sidebar.ini
-rw-rw-r--  1 ron ron   226 2017-04-10 21:55:27 Citations_citationlistview.ini
-rw-rw-r--  1 ron ron   611 2017-04-10 21:55:27
Citations_citationlistview_bottombar.ini
-rw-rw-r--  1 ron ron   281 2017-04-10 21:55:27
Citations_citationlistview_sidebar.ini
-rw-rw-r--  1 ron ron    68 2017-01-29 01:39:58 Dashboard_dashboardview.ini
-rw-rw-r--  1 ron ron   194 2017-04-07 22:19:01 Events_eventview.ini
-rw-rw-r--  1 ron ron   904 2017-04-07 22:19:01 Events_eventview_bottombar.ini
-rw-rw-r--  1 ron ron   272 2017-04-07 22:19:01 Events_eventview_sidebar.ini
-rw-rw-r--  1 ron ron   183 2017-04-07 21:53:31 Families_familyview.ini
-rw-rw-r--  1 ron ron  1235 2017-04-07 21:53:31
Families_familyview_bottombar.ini
-rw-rw-r--  1 ron ron   275 2017-04-07 21:53:31 Families_familyview_sidebar.ini
-rw-rw-r--  1 ron ron   310 2017-04-05 02:42:00 Geography_geo4.ini
-rw-rw-r--  1 ron ron   119 2017-04-05 02:42:00 Geography_geo4_bottombar.ini
-rw-rw-r--  1 ron ron   275 2017-04-05 02:42:00 Geography_geo4_sidebar.ini
-rw-rw-r--  1 ron ron   728 2017-01-29 01:39:58
Gramplets_dashboardview_gramplets.ini
-rw-rw-r--  1 ron ron   179 2017-04-02 19:51:40 Media_mediaview.ini
-rw-rw-r--  1 ron ron   908 2017-04-02 19:51:40 Media_mediaview_bottombar.ini
-rw-rw-r--  1 ron ron   272 2017-04-02 19:51:39 Media_mediaview_sidebar.ini
-rw-rw-r--  1 ron ron   162 2017-04-10 21:55:27 Notes_noteview.ini
-rw-rw-r--  1 ron ron   275 2017-04-10 21:55:27 Notes_noteview_bottombar.ini
-rw-rw-r--  1 ron ron   269 2017-04-10 21:55:27 Notes_noteview_sidebar.ini
-rw-rw-r--  1 ron ron   243 2017-04-26 19:19:16 People_personlistview.ini
-rw-rw-r--  1 ron ron   787 2017-04-26 19:19:16
People_personlistview_bottombar.ini
-rw-rw-r--  1 ron ron   275 2017-04-26 19:19:16
People_personlistview_sidebar.ini
-rw-rw-r--  1 ron ron   242 2017-01-29 15:23:10 People_personview.ini
-rw-rw-r--  1 ron ron  1585 2017-01-29 15:23:10 People_personview_bottombar.ini
-rw-rw-r--  1 ron ron   119 2017-01-29 15:23:10 People_personview_sidebar.ini
-rw-rw-r--  1 ron ron   201 2017-04-21 20:13:24 Places_placelistview.ini
-rw-rw-r--  1 ron ron  1057 2017-04-21 20:13:24
Places_placelistview_bottombar.ini
-rw-rw-r--  1 ron ron   272 2017-04-21 20:13:24 Places_placelistview_sidebar.ini
-rw-rw-r--  1 ron ron   196 2015-08-17 12:46:47 Places_placetreeview.ini
-rw-rw-r--  1 ron ron  1057 2015-08-17 12:46:47
Places_placetreeview_bottombar.ini
-rw-rw-r--  1 ron ron   272 2015-08-17 12:46:47 Places_placetreeview_sidebar.ini
-rw-rw-r--  1 ron ron   191 2017-04-27 10:37:44 Relationships_relview.ini
-rw-rw-r--  1 ron ron   787 2017-04-27 10:37:44
Relationships_relview_bottombar.ini
-rw-rw-r--  1 ron ron   281 2017-04-27 10:37:44
Relationships_relview_sidebar.ini
-rw-rw-r--  1 ron ron   242 2017-04-05 19:46:49 Repositories_repoview.ini
-rw-rw-r--  1 ron ron   629 2017-04-05 19:46:49
Repositories_repoview_bottombar.ini
-rw-rw-r--  1 ron ron   287 2017-04-05 19:46:49
Repositories_repoview_sidebar.ini
-rw-rw-r--  1 ron ron   179 2017-04-10 21:55:27 Sources_sourceview.ini
-rw-rw-r--  1 ron ron   757 2017-04-10 21:55:27 Sources_sourceview_bottombar.ini
-rw-rw-r--  1 ron ron   275 2017-04-10 21:55:27 Sources_sourceview_sidebar.ini
-rw-rw-r--  1 ron ron  4444 2017-04-07 22:21:37 custom_filters.xml
-rw-rw-r--  1 ron ron  5369 2017-04-27 10:37:44 gramps.ini
drwxrwxr-x 67 ron ron  4096 2017-03-31 10:18:42 plugins/


$ dir .gramps/grampsdb/58e91f6b
total 79712
-rw-rw-r-- 1 ron ron       10 2017-04-08 12:35:39 bdbversion.txt
-rw-rw-r-- 1 ron ron   688128 2017-04-27 12:01:14 citation.db
-rw-rw-r-- 1 ron ron   558336 2017-04-14 01:24:31 citation.gbkp
-rw-rw-r-- 1 ron ron   172032 2017-04-14 01:24:31 citation_id.db
-rw-rw-r-- 1 ron ron  5283840 2017-04-27 12:01:14 event.db
-rw-rw-r-- 1 ron ron  4380314 2017-04-14 01:24:31 event.gbkp
-rw-rw-r-- 1 ron ron  1277952 2017-04-14 01:24:31 event_id.db
-rw-rw-r-- 1 ron ron  1445888 2017-04-27 12:01:14 family.db
-rw-rw-r-- 1 ron ron  1269659 2017-04-14 01:24:31 family.gbkp
-rw-rw-r-- 1 ron ron   176128 2017-04-13 12:16:53 family_id.db
-rw-rw---- 1 ron ron 10485759 2017-05-02 16:01:02 log.0000000018
-rw-rw-r-- 1 ron ron   352256 2017-04-27 12:01:14 media.db
-rw-rw-r-- 1 ron ron   222759 2017-04-14 01:24:31 media.gbkp
-rw-rw-r-- 1 ron ron    53248 2017-04-13 01:52:18 media_id.db
-rw-rw-r-- 1 ron ron    81920 2017-04-27 12:01:14 meta_data.db
-rw-rw-r-- 1 ron ron    72943 2017-04-14 01:24:31 meta_data.gbkp
-rw-rw-r-- 1 ron ron       15 2017-04-08 12:35:48 name.txt
-rw-rw-r-- 1 ron ron    20480 2017-04-08 12:35:50 name_group.db
-rw-rw-r-- 1 ron ron  1822720 2017-04-27 12:01:14 note.db
-rw-rw-r-- 1 ron ron   979884 2017-04-14 01:24:31 note.gbkp
-rw-rw-r-- 1 ron ron   167936 2017-04-14 01:24:31 note_id.db
-rw-rw-r-- 1 ron ron  5754880 2017-04-27 12:01:14 person.db
-rw-rw-r-- 1 ron ron  4305162 2017-04-14 01:24:31 person.gbkp
-rw-rw-r-- 1 ron ron   667648 2017-04-13 23:53:52 person_id.db
-rw-rw-r-- 1 ron ron        3 2017-04-08 12:35:39 pickleupgrade.txt
-rw-rw-r-- 1 ron ron  1331200 2017-04-27 12:01:14 place.db
-rw-rw-r-- 1 ron ron  1006272 2017-04-14 01:24:31 place.gbkp
-rw-rw-r-- 1 ron ron   323584 2017-04-14 01:24:31 place_id.db
-rw-rw-r-- 1 ron ron   430080 2017-04-14 01:24:31 place_parent.db
-rw-rw-r-- 1 ron ron 10182656 2017-04-14 01:24:31 primary_map.db
-rw-rw-r-- 1 ron ron        1 2017-04-08 12:35:39 pythonversion.txt
-rw-rw-r-- 1 ron ron 17477632 2017-04-14 01:24:31 reference_map.db
-rw-rw-r-- 1 ron ron 10731520 2017-04-14 01:24:31 referenced_map.db
-rw-rw-r-- 1 ron ron    20480 2017-04-27 12:01:14 repo.db
-rw-rw-r-- 1 ron ron     4417 2017-04-14 01:24:31 repo.gbkp
-rw-rw-r-- 1 ron ron    20480 2017-04-08 12:36:25 repo_id.db
-rw-rw-r-- 1 ron ron        2 2017-04-08 12:35:39 schemaversion.txt
-rw-rw-r-- 1 ron ron   102400 2017-04-27 12:01:14 source.db
-rw-rw-r-- 1 ron ron    84010 2017-04-14 01:24:31 source.gbkp
-rw-rw-r-- 1 ron ron    32768 2017-04-13 01:52:18 source_id.db
-rw-rw-r-- 1 ron ron   606208 2017-04-14 01:24:31 surnames.db
-rw-rw-r-- 1 ron ron    20480 2017-04-27 12:01:14 tag.db
-rw-rw-r-- 1 ron ron      363 2017-04-14 01:24:31 tag.gbkp
-rw-rw-r-- 1 ron ron    20480 2017-04-08 12:36:25 tag_name.db



On 05/02/2017 05:29 PM, otyugh wrote:

> Is there any string I could look for to identify the 1-2 files that
> could restore the "big part" of what he did on gramps ? I have no idea
> how Gramps data works.
>
>> You didn't mention what operating system, but if it is a Microsoft
>> one, have you tried Recuva?
> GNU/Linux, Ubuntu, ext4. Does recuva handle ext4 ?
>
> I dumped everything in a raw image, I can still try things if you know
> any other way.
>
>
>> This is more than just a Gramps recovery, I presume?
> The other stuff are not much of a problem.

--
World Peace Through Nuclear Pacification


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Gramps-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gramps-users
https://gramps-project.org
Reply | Threaded
Open this post in threaded view
|

Re: Restore Gramps session from recovered files (Photorec)

manzi.sam
In reply to this post by otyugh
CONTENTS DELETED
The author has deleted this message.
Reply | Threaded
Open this post in threaded view
|

Re: Restore Gramps session from recovered files (Photorec)

Tom Samstag
In reply to this post by otyugh
Gramps stores its data in a bunch of berkley db files (each of my directories has 27 .db files). I'm
not sure if photorec has a signature to recover berkley db files by default, but other carvers may.
If the drive contained backups (.gpkg) of the family tree, those are just gzip'ed tar files. You
should be able to identify them by the original file (stored in the gzip header) as a .gpkg file,
instead of a more traditional .tar file. The tarball contains a file named data.gramps which itself
is a gzip'ed xml file.

Good luck on the recovery.

On 2017-05-02 15:29, otyugh wrote:

> Is there any string I could look for to identify the 1-2 files that
> could restore the "big part" of what he did on gramps ? I have no idea
> how Gramps data works.
>
>> You didn't mention what operating system, but if it is a Microsoft
>> one, have you tried Recuva?
>
> GNU/Linux, Ubuntu, ext4. Does recuva handle ext4 ?
>
> I dumped everything in a raw image, I can still try things if you know
> any other way.
>
>
>> This is more than just a Gramps recovery, I presume?
> The other stuff are not much of a problem.
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Gramps-users mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/gramps-users
> https://gramps-project.org
>

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Gramps-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gramps-users
https://gramps-project.org
Ken
Reply | Threaded
Open this post in threaded view
|

Re: Restore Gramps session from recovered files (Photorec)

Ken
In reply to this post by Ron Johnson
That is where all your data is.

Once that's restored it should be easy.


On 02/05/17 03:53 PM, Ron Johnson wrote:
> $ dir .gramps/grampsdb/58e91f6b


------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Gramps-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gramps-users
https://gramps-project.org
Reply | Threaded
Open this post in threaded view
|

Re: Restore Gramps session from recovered files (Photorec)

Stephen George
In reply to this post by Ron Johnson

Hi,


On 03/05/17 08:53, Ron Johnson wrote:
There are BSDDB files, and plenty of xml files, so "file" should help.  
Unfortunately, there are a *lot* of database files.
Just to re-iterate Ron's  point above as I think it might get lost in all the noise.

file will help you work out what type of files you are dealing with, it does that by looking inside the file for a magic number (file signature), .. at least you will be able to correct the file extension for a large set of those 50,000 files (you would have to script it of course).
 

see 'man file' to see all options.

i.e. some examples from my computer

A Berkley data base can be identified
 $ file .gramps/grampsdb/58772aa0/primary_map.db
.gramps/grampsdb/58772aa0/primary_map.db: Berkeley DB (Btree, version 9, native byte-order)

Knowing which files are Berkley database files, will make your problem so much smaller than it is now. (50,000)


Unfortunately .ini files will be tagged as text, so you can expect a lot of text files.
$ file .gramps/gramps42/Families_familyview.ini
.gramps/gramps42/Families_familyview.ini: ASCII text

At least you could write a script to iterate over text files looking inside each one for unique words that might appear only in Gramps ini files (you would need to do some research first)

Pictures can be identified
$ file Pictures/FujiXt1/20160727/DSCF0461.JPG
Pictures/FujiXt1/20160727/DSCF0461.JPG: JPEG image data, Exif standard: [TIFF image data, little-endian, direntries=12, manufacturer=FUJIFILM, model=X-T1, orientation=lower-left, xresolution=174, yresolution=182, resolutionunit=2, software=Digital Camera X-T1 Ver4.10, datetime=2016:07:27 19:51:00, copyright=                                                               ], baseline, precision 8, 4896x3264, frames 3

Word documents
$  file Documents/Spring\ Gala\ 2015\ DVD\ order\ form.docx
Documents/Spring Gala 2015 DVD order form.docx: Microsoft Word 2007+

pdf files
$ file SwagCool.pdf
SwagCool.pdf: PDF document, version 1.4

Once you correct the extension then at least the file can be opened in the correct tool to see if it is of any value or not.

Good luck
Steve




------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Gramps-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gramps-users
https://gramps-project.org