#29936 - 21/04/2001 16:29
backup (again)
|
old hand
Registered: 12/08/2000
Posts: 702
Loc: Netherlands
|
As I was hearing a lot of requests from people for a backup-utility, and they didn't have the ability or knowledge to use any of the available programs(great work, ynot & synergy), I have spent some time creating a windows backup-utility for the empeg. It still needs displayserver running on the empeg.
It works like this:
You create a CSV file with emplode. The CSV file contains all the installed MP3's and playlists.
Start empegbackup.
Give the location of the CSV-file.
Give the directory where the data should be stored.
Give the URL of displayserver running on your empeg.
Click start.
Here's a screenshot:
You can get it here
Installation Instructions :
Just unzip and run.
Frank van Gestel
_________________________
Frank van Gestel
|
Top
|
|
|
|
#29937 - 21/04/2001 23:23
Re: backup (again)
[Re: fvgestel]
|
carpal tunnel
Registered: 20/12/1999
Posts: 31597
Loc: Seattle, WA
|
Frank, let me be the first to say it:
YOU DA MAN!
The corresponding entry in the FAQ has been updated. ___________
Tony Fabris
|
Top
|
|
|
|
#29938 - 22/04/2001 10:02
Re: backup (again)
[Re: tfabris]
|
carpal tunnel
Registered: 05/01/2001
Posts: 4903
Loc: Detroit, MI USA
|
Speechless....
Does this save as one big file or as individual mp3's? If it is one big file, how do you get the info back on the empeg?
32GB (JUST UPGRADED!) Mk. II BLUE
Detroit, MI USA
www.PfeifferBeer.com
_________________________
Brad B.
|
Top
|
|
|
|
#29939 - 22/04/2001 10:57
Re: backup (again)
[Re: SE_Sport_Driver]
|
old hand
Registered: 12/08/2000
Posts: 702
Loc: Netherlands
|
Multiple files are saved. every MP3 or playlist on the empeg is stored as one datafile and one "tag"-file. The datafile is transferred from the empeg with the filename as stored on the empeg. tag-files are recreated using the data in the CSV-file. I haven't tried an actual restore yet, but I didn't claim it to be a restore program, did I Frank van Gestel
_________________________
Frank van Gestel
|
Top
|
|
|
|
#29940 - 23/04/2001 09:48
Re: backup (again)
[Re: fvgestel]
|
old hand
Registered: 12/01/2000
Posts: 1079
Loc: Dallas, TX
|
Wow! I really appreciate your hard work on this.
Thanks!
80000078
|
Top
|
|
|
|
#29941 - 23/04/2001 12:36
Re: backup (again)
[Re: fvgestel]
|
veteran
Registered: 19/06/2000
Posts: 1495
Loc: US: CA
|
You never cease to amaze. Nice work! Now it just needs a way to work without displayserver. Seems like everytime I install it it ends up messing up my playlists. Maybe you could help me figure this one out?
________
Donato
MkII/Blue/40GB/080000565
_________________________
Donato MkII/080000565 MkIIa/010101253 ricin.us
|
Top
|
|
|
|
#29942 - 23/04/2001 13:00
Re: backup (again)
[Re: fvgestel]
|
addict
Registered: 13/06/2000
Posts: 429
Loc: Berlin, DE
|
a couple things.
source to the empeg backup?
I was considering spending the time to get amanda network backup to work with the empeg.. and maybe write up some scripts to backup the playlist partition with dd.
hrm....
12gig red mk2 -- 080000125
_________________________
80gig red mk2 -- 080000125 (No, I don't actually hate Alan Cox)
|
Top
|
|
|
|
#29943 - 23/04/2001 14:02
Re: backup (again)
[Re: SuperQ]
|
old hand
Registered: 12/08/2000
Posts: 702
Loc: Netherlands
|
source to the empeg backup?
Source is nothing special; about 100 lines of code. I used Delphi 4, which has standard internet components. I downloaded a CSV-component from http://www.jansfreeware.com
The program justs iterates the CSV-file and downloads every file found using the HTTP-component. you can download a specific file by looking up it's FID in the CSV file and send a HTTP-request to displayserver : http://empeg/ttt.mp3?file=FID. The requested file file will be streamed back.
When 2.0 is finished, it will probably have a way to restore too, so the app is going to change. This was just a fast way to let people backup their empeg. I liked the stats about the network.
I like stats...
write up some scripts to backup the playlist partition
Have you tried ynot's perl-script? Maybe you could combine it with the CSV to do selective backups.
I like perl...
BTW: Does anyone by chance have a small standalone perl-executable for empeg? I've tried crosscompiling without result. Frank van Gestel
_________________________
Frank van Gestel
|
Top
|
|
|
|
#29944 - 23/04/2001 16:01
Re: backup (again)
[Re: ricin]
|
carpal tunnel
Registered: 21/05/1999
Posts: 5335
Loc: Cambridge UK
|
Backing up without displayserver would be nice.. if only there were some way to do it, some hook in emptool for example, if only..
|
Top
|
|
|
|
#29945 - 23/04/2001 16:31
Perl (was Re: backup (again))
[Re: fvgestel]
|
pooh-bah
Registered: 13/09/1999
Posts: 2401
Loc: Croatia
|
I found precompiled Perl in the archive you pointed to in this your post . It is compiled, but not statically linked. I unpacked archive debian-image_990822_tar.gz somewhere in /drive0, moved perl into path, and tried running it. As it complained about missing .so libs, I symlinked one by one into /lib (or was it /usr/lib?) - I could not remember how to list dynamic link libraries a program requires :-). Dragi "Bonzi" Raos
Zagreb, Croatia
Q#5196, MkII#80000376, 18GB green
_________________________
Dragi "Bonzi" Raos
Q#5196
MkII #080000376, 18GB green
MkIIa #040103247, 60GB blue
|
Top
|
|
|
|
#29946 - 23/04/2001 16:40
Perl (was Re: backup (again))
[Re: bonzi]
|
old hand
Registered: 12/08/2000
Posts: 702
Loc: Netherlands
|
I could not remember how to list dynamic link libraries a program requires
ldd
Frank van Gestel
_________________________
Frank van Gestel
|
Top
|
|
|
|
#29947 - 23/04/2001 16:42
Perl (was Re: backup (again))
[Re: fvgestel]
|
pooh-bah
Registered: 13/09/1999
Posts: 2401
Loc: Croatia
|
Why can't I refere to another post any more? Copy and past an URL should not be that difficult, even for me
Anyway, tha pachage where I found Perl is http://fvgestel.dyndns.org/empeg/debian/debian-image_990822_tar.gz . Wait! It is on your site! Why are you trying to crosscompile it when you already have it? Or did I missunderstand something? Dragi "Bonzi" Raos
Zagreb, Croatia
Q#5196, MkII#80000376, 18GB green
_________________________
Dragi "Bonzi" Raos
Q#5196
MkII #080000376, 18GB green
MkIIa #040103247, 60GB blue
|
Top
|
|
|
|
#29948 - 23/04/2001 16:48
Perl (was Re: backup (again))
[Re: bonzi]
|
old hand
Registered: 12/08/2000
Posts: 702
Loc: Netherlands
|
I have experimented with the perl that was in that debian file, but it was too large; I was looking for a stripped out version for basic scripting. I can also remember doing a try compiling on the empeg, but I think it needed floating point. Maybe a perl4 binary will do.
Frank van Gestel
_________________________
Frank van Gestel
|
Top
|
|
|
|
#29949 - 23/04/2001 17:00
Perl (was Re: backup (again))
[Re: bonzi]
|
carpal tunnel
Registered: 20/12/1999
Posts: 31597
Loc: Seattle, WA
|
Why can't I refere to another post any more? Copy and past an URL should not be that difficult, even for me
Normally, it does work. Somehow, the link you posted lost the question mark following the PHP script name...
...showthreaded.php?Cat=...
Put the question mark back in, and it works.
Are you using a non-English browser? Maybe the question mark is a different character in your localization. ___________
Tony Fabris
|
Top
|
|
|
|
#29950 - 23/04/2001 17:00
Re: backup (again)
[Re: rob]
|
carpal tunnel
Registered: 23/08/2000
Posts: 3826
Loc: SLC, UT, USA
|
is it just me or is Rob eluding to the point that there is already something in the emptool source to accomplish a backup....
|| loren.cox ||
|
Top
|
|
|
|
#29951 - 23/04/2001 17:06
Re: backup (again)
[Re: loren]
|
pooh-bah
Registered: 13/09/1999
Posts: 2401
Loc: Croatia
|
is it just me or is Rob eluding to the point that there is already something in the emptool source to accomplish a backup....
...or is he just teasing us?
Well, they *did* promise playlists (but not tunes) backup a while ago... Dragi "Bonzi" Raos
Zagreb, Croatia
Q#5196, MkII#80000376, 18GB green
_________________________
Dragi "Bonzi" Raos
Q#5196
MkII #080000376, 18GB green
MkIIa #040103247, 60GB blue
|
Top
|
|
|
|
#29952 - 23/04/2001 17:21
Re: backup (again)
[Re: bonzi]
|
carpal tunnel
Registered: 20/12/1999
Posts: 31597
Loc: Seattle, WA
|
I always figured that if you looked closely enough at the emptool sources, you could figure out how to pull/push any files you wanted. I'm surprised no one's done it yet.
As I was researching the "Reboot" function of the logo editor, I seem to recall having seen stuff like that. I never researched it any further, though.
Perhaps it's one of those things that isn't explicitly stated in the source code, but you can figure it out if you map out all of the protocols. ___________
Tony Fabris
|
Top
|
|
|
|
#29953 - 24/04/2001 08:18
Re: backup (again)
[Re: tfabris]
|
new poster
Registered: 19/07/1999
Posts: 19
|
I think so, when I first looked at the source, I figured someone was going to come up with a backup utility in a few weeks because I noticed the code in protocolclient.cpp had ReadFidToMemory and WriteFidFromMemory. I'm a very novice C and C++ reader, so I may be wrong here, but it appears that ReadFidToMemory is used by emptool to read the playlist database, the tags file, etc.
Assuming ReadFidToMemory can read any file on the empeg to memory, then that memory could be writen to a local file. So, it would seem like the framework to copy fids back from the player is already there, the source just needs to be abused a bit.
Am I close Rob? I would have experimented way back when, but I never found the time to relearn the little C++ I know.
|
Top
|
|
|
|
#29954 - 24/04/2001 09:07
Re: backup (again)
[Re: tychl]
|
old hand
Registered: 12/08/2000
Posts: 702
Loc: Netherlands
|
I think you're right. I've never tried to compile the emptool for win32 as I don't have visual C++. I only looked at the code to see how a USB-connection was established and programmed that in Delphi. In this post is someone who managed to get emptool compiled for win32 with ethernet support. The distribution contains some .lib files, which I will try to import in Delphi, though I think VC++ .lib files aren't the same as Borland .lib files. Maybe someone with access to VC++ could create a DLL?
Frank van Gestel
_________________________
Frank van Gestel
|
Top
|
|
|
|
#29955 - 24/04/2001 09:14
Re: backup (again)
[Re: bonzi]
|
carpal tunnel
Registered: 21/05/1999
Posts: 5335
Loc: Cambridge UK
|
I don't really know much about programming or backups, it's all beyond me, I'd better just leave you guys to it eh?
Rob
|
Top
|
|
|
|
#29956 - 24/04/2001 17:36
Re: backup (again)
[Re: rob]
|
carpal tunnel
Registered: 15/08/2000
Posts: 4859
Loc: New Jersey, USA
|
I still like the "cows_have_spoons" command...
Paul G. SN# 090000587 (40GB Green)
_________________________
Paul Grzelak 200GB with 48MB RAM, Illuminated Buttons and Digital Outputs
|
Top
|
|
|
|
#29957 - 30/04/2001 20:30
Re: backup (again)
[Re: pgrzelak]
|
carpal tunnel
Registered: 05/01/2001
Posts: 4903
Loc: Detroit, MI USA
|
I noticed the 4GB bug seems to be present still... or else I was having some other problem. But, by editing the outputted CSV file, I was able to continue where the back up stalled. Very easy to use!
32GB (JUST UPGRADED!) Mk. II BLUE
Detroit, MI USA
www.PfeifferBeer.com
_________________________
Brad B.
|
Top
|
|
|
|
#29958 - 02/05/2001 12:02
Re: backup (again)
[Re: SE_Sport_Driver]
|
carpal tunnel
Registered: 05/01/2001
Posts: 4903
Loc: Detroit, MI USA
|
So, was the 4GB "bug" traced to displayserver, windows, linux or anything else? BTW: it is very easy to resume when it konks out after 4GB by editing the CSV file...
32GB (JUST UPGRADED!) Mk. II BLUE
Detroit, MI USA
www.PfeifferBeer.com
_________________________
Brad B.
|
Top
|
|
|
|
#29959 - 02/05/2001 14:47
Re: backup (again)
[Re: SE_Sport_Driver]
|
old hand
Registered: 12/08/2000
Posts: 702
Loc: Netherlands
|
The original bug was caused by myself, by being so stupid to forget that files have sizelimits, but hey, it was though out and implemented in about 30 minutes. The backup-utility however shouldn't have this limit, as it is transferring and writing multiple small files to disk. I know of some problems with displayserver and playlists, but files should download correctly. Maybe a FAT/FAT32 limit on the number of directory entries?
BTW have you got the player running while backing up? When you stop the player app, you will notice an increase in speed of about 100%, at least that's my experience(250kbs/500kbs).
I haven't downloaded that amount myself; I stopped at 2 Gb.
I will try to make a full backup soon, and let you know...
Frank van Gestel
_________________________
Frank van Gestel
|
Top
|
|
|
|
#29960 - 02/05/2001 19:06
Re: backup (again)
[Re: fvgestel]
|
veteran
Registered: 16/06/1999
Posts: 1222
Loc: San Francisco, CA
|
Full backup didn't work for me - the speed started getting into the negatives :) and eventually stopped.
-mark
...proud to have owned an Empeg since 00287
|
Top
|
|
|
|
#29961 - 03/05/2001 10:06
Re: backup (again)
[Re: dionysus]
|
carpal tunnel
Registered: 05/01/2001
Posts: 4903
Loc: Detroit, MI USA
|
Yep, speed got into negatives after about 1000 files (around 4gb or so)...
32GB (JUST UPGRADED!) Mk. II BLUE
Detroit, MI USA
www.PfeifferBeer.com
_________________________
Brad B.
|
Top
|
|
|
|
#29962 - 03/05/2001 10:34
Re: backup (again)
[Re: SE_Sport_Driver]
|
old hand
Registered: 12/01/2000
Posts: 1079
Loc: Dallas, TX
|
The cause of this is a memory leak in displayserver. 4GB is about the limit it will transfer before linux kills the process. Just reboot the player and keep going, that may work.
Sean
80000078
|
Top
|
|
|
|
#29963 - 03/05/2001 12:14
Re: backup (again)
[Re: Terminator]
|
carpal tunnel
Registered: 05/01/2001
Posts: 4903
Loc: Detroit, MI USA
|
That is what I have been doing. Reboot the player, edit the CSV file and resume.
32GB (JUST UPGRADED!) Mk. II BLUE
Detroit, MI USA
www.PfeifferBeer.com
_________________________
Brad B.
|
Top
|
|
|
|
#29964 - 07/05/2001 00:55
Re: backup (again)
[Re: fvgestel]
|
old hand
Registered: 12/08/2000
Posts: 702
Loc: Netherlands
|
Well I tried the full backup and indeed it stopped after 3.xx Gb. I edited the CSV file to contain only multiple copies of playlists (which are very small) and it seemed the limit isn't related to size, but the number of downloads. Looked through the code and yes, the serve_file routine exits at the end, before closing the socket file descriptor. Due to the nature of the app, displayserver keeps allocating new filedescriptors till the limit is reached and dies...
I will make a version 1.2 where this will be fixed...
Frank van Gestel
_________________________
Frank van Gestel
|
Top
|
|
|
|
#29965 - 07/05/2001 06:11
Re: backup (again)
[Re: fvgestel]
|
carpal tunnel
Registered: 05/01/2001
Posts: 4903
Loc: Detroit, MI USA
|
Frank, you have to set up some Paypal account or something so you can get paid for this!
32GB (JUST UPGRADED!) Mk. II BLUE
Detroit, MI USA
www.PfeifferBeer.com
_________________________
Brad B.
|
Top
|
|
|
|
|
|