Diese Seite mit anderen teilen ...

Informationen zum Thema:
Forum:
WinDev Forum
Beiträge im Thema:
9
Erster Beitrag:
vor 4 Monaten, 4 Wochen
Letzter Beitrag:
vor 4 Monaten, 3 Wochen
Beteiligte Autoren:
Arie, Alexandre Leclerc, Allard, Mr Black, Fabrice Harari

hfsql backup question

Startbeitrag von Arie am 21.03.2017 09:46

Hi,

one of my clients likes the idea of an cloud backup for his data. There are a dozen of companies offering these services. At first not that difficult, one can include the BDD map in the backup, right?

But will this work for the data files, because the hfsql server is always up and running and therefore these files may be open of even in cache?
Anyone having experience with this?

I also tried the hot-backup option to make a local backup and then use this local version for a cloud backup. of hfsql but this one is veeery slow, it looks like it does a record-by-record backup.
I also have one very large file (100GB+) holding photos. I can't backup the file as a whole, this would take too long on with their current adls connection. Some tools are able to detect which parts of a file are changed. Will that work for hfsql files?

Antworten:

And does someone know if hfsql supports VSS (Volume Shadow Copy) of Windows. Where Windows sends a message to subscriber to flush the data 'now'?

von Arie - am 21.03.2017 10:00
Hi Arie,

I'm doing that using WXReplication. The local DB is replicated on a DB server in the cloud, and that's it...
The original backup is relatively slow , as all records have to be managed, but once this is done, only added/modified/deleted records are managed, so it's fast and quasi real time. And because WXreplication is NOT linked to any specific DB, you can use whatever DB you want on the server side.

It is also possible to replicate onto another local server, so as to have an immediate switch/replace server available if needed.

Of course, any working replication system will offer the same functionnality

Best regards

von Fabrice Harari - am 21.03.2017 11:11
Fabrice,

I thought of that indeed, either your WXReplication (preferred :-)) or the build-in one from Montpellier (not preferred as it is a black box with possible bugs I can not control).

But using it for backup purposes means I am responsible for the backup as well. And that is a no-go for me.

von Arie - am 21.03.2017 11:35
Hi Arie,

We us a very simple solution: we ask HFSQL to do an automatic backup. HFSQL is backing-up the actual “state” and continues to work while making the backup. This can be configured in the Control Centre. The file is saved in a backup directory. Then this backup directory is automatically sent in the cloud. (Use the technology you want for that, there are many many choices available.)

We forgot about backups a while ago and it is very efficient and safe.

Best regards,
Alexandre Leclerc

von Alexandre Leclerc - am 22.03.2017 19:30
Hi Arie.. We ran into a similar problem. Large data file containing attachments that became too unwieldy to use the native HFCS scheduled backup.

We got around this and shortened the backup window greatly.
Two stored procedures.

1. Archive: Pushes attachments from mmo fields into files/directory(s) on hfcs, clears the mmo, sets an archive field, and sets a guid field used for the filename.

2. Retrieve: If archive flag set, pulls file back into mmo field for the client to use.

A minor update was needed in the application to check the archive flag, and conditionally run retrieve SP when the application requested an attachment.
A second update to run the archive SP once a month followed by compress on the data file.

This allowed us to use standard hfcs automated backup in conjunction with rsync to grab both the hfcs backup zip and the attachment directories. Rsync manages the deltas for the attachments, so once the intital attachment backup is in the cloud, only additions/deletions get processed after that.

In our case, we were backing up and transferring about 30g of attachments nightly. After implementing the above, nightly transfers of attachments are less than a gig.. Substantial improvement.

Can’t wait for hfcs to become vss aware in some form.. ie (flush buffers, shadow copy disk, backup, release shadow copy), then delta backups would become trivial..

von Mr Black - am 23.03.2017 20:06
Hi Arie,

Look at stackstorage.com. For people in Holland and Belgium 1 TB free cloud space. The y profide a cool sig programm with it. This works verry fast.

regards

Allard

von Allard - am 24.03.2017 08:21
Mr Black,

interesting idea. Even better is, that I already have part 1 up and running. Mainly because years ago I was a bit anxious about putting lots of images in the database. Therefore every image is stored as the (original) file as well, using a SP on the server. After years I can say the MMO file only got corrupted a few times. But then I lost just one particular image. The rest of the images were accessible as usual.
It is btw a field service solution with technicians using tablets in the field. They make photos on almost every job.

Have to mention that I also have another app, a document managament system with over 4 million sacnned documents. Stored in a MSSQL server. And that one NEVER had a problem over the last 8 years or so.

von Arie - am 24.03.2017 09:36
Hi Mr. Black,

This is a very nice solution for big documents. Thanks for sharing this!

I did not see Aries' comment about the huge 100GB+ database and the simple solution we use would not be efficient in such a case.

Best regards,
Alexandre Leclerc

von Alexandre Leclerc - am 24.03.2017 12:20
Zur Information:
MySnip.de hat keinen Einfluss auf die Inhalte der Beiträge. Bitte kontaktieren Sie den Administrator des Forums bei Problemen oder Löschforderungen über die Kontaktseite.
Falls die Kontaktaufnahme mit dem Administrator des Forums fehlschlägt, kontaktieren Sie uns bitte über die in unserem Impressum angegebenen Daten.