Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.




2952 posts

Uber Geek

Trusted
Lifetime subscriber

#114923 7-Mar-2013 13:33
Send private message

Hi,

We are about to embark on an integration project between a Filemaker database and a website. The Filemaker database is all built and is being used on a daily basis. The website will have a mysql database.

The plan is to have the mysql database separate from the Filemaker database for:

1. Security
2. Only a subset of information is on the website database
3. Ensure the Filemaker database is fast to use
4. Retain offline database capabilities should connectivity be lost.

So, if information is updated in the MySQL database it will be pushed to the Filemaker database and visa versa.

Anyone see any downfalls with this plan? Is this how it is done in the real world with enterprise systems? It could all be built with a single MySQL database but we don't really want to go down that track given the issues outlined above.

Cheers, Matt.




My views (except when I am looking out their windows) are not those of my employer.


Create new topic
16173 posts

Uber Geek

Trusted
Subscriber

  #776257 7-Mar-2013 14:30
Send private message

In an enterprise system you would probably have a single database to reduce complexity and costs. You could probably write a little problem (or find one) that extracts information from Filemaker and inserts/updates MySQL. Your first three issues don't look like real issues to me, they look like lack of experience and knowledge. Re offline access, you can always have a local MySQL database as well as a hosted database. Internet access doesn't go down much these days.

If you set up MySQL and your application correctly then security isn't an issue, probably less of an issue than synchronisation.

8035 posts

Uber Geek

Trusted

  #776311 7-Mar-2013 15:28
Send private message

Unless your web DB is read only or your local and web DB write to completely different tables/row I wouldn't recommend it.

Two way sync is hard.. resolving conflicts when the same exact row is changed in both DB's at the same time is nasty.

 
 
 
 


3463 posts

Uber Geek

Trusted

  #776313 7-Mar-2013 15:31
Send private message

timmmay:You could probably write a little problem (or find one) that extracts information from Filemaker and inserts/updates MySQL.


Yes, or a not-so-little problem, if you decide to go down this route :D




"I was born not knowing and have had only a little time to change that here and there."         | Electric Kiwi | Sharesies
              - Richard Feynman


1423 posts

Uber Geek
Inactive user


  #786362 24-Mar-2013 19:36
Send private message

hairy1: Hi,


2. Only a subset of information is on the website database
3. Ensure the Filemaker database is fast to use
4. Retain offline database capabilities should connectivity be lost.



Cheers, Matt.


Its kind of hard to define a plan without sitting down and doing a spec of what you need. For instance - are you updating records or appending new records? do the records need to be balanced across both Dbs with the exact same keys and are the keys sequential / automatically generated etc?

Are there date fields to ensure no conflict records etc?

As for synching data in and out - it depends on how automated / human driven you want it to be.

Using an SOA architecture to transfer stuff around might help or else look at an intermediate staging database with replicating features (such as mysql both on the web and local ) and then import / export stuff from the staging DB.

Security can be achieved with automated systems and web services etc but it depends on a whole range or variables in your systems.

Using xml export on both sides, manually moving the files to and from the web / local and importing them might work and leaves you not exposing yourself to an permanently open connection to the web but it depends on how immediate the updates need to be. A replicating system every x minutes is a different process to write than an immediate mirrored set of records.

Using services / agents / and keeping only a local DB:
  1. Security can be maintained by using services to get / put data onto the local DB.
  2. Sanitizing the results properly gets rid of most exploit vectors.
  3. Speed of the filemaker DB shouldn't be an issue unless you have a hugely intensive drain on the web and local. If it is that heavy then you should be considering more hardware or a better DBMS anyway.

Shane





2952 posts

Uber Geek

Trusted
Lifetime subscriber

  #786431 24-Mar-2013 21:55
Send private message

Hey foks,

Thanks for the input. After actually sitting down and have a decent think about what was required the following is going to be implemented:

1. Filemaker will be the master database and any changes are replicated in the Mysql database
2. An additional Mysql table will take any changes that are required from the website (which will be minimal) and will be vetted by the filemaker database users before being inserted into the filemaker database.

It should work ok. The prime concern was to make sure that the web database was separate from the Filemaker database. There is no real time updating of both databases and the website database will have minimal input into the filemaker database (if this makes sense at 10 pm on a Sunday night!)

Cheers, Matt.




My views (except when I am looking out their windows) are not those of my employer.


Create new topic




News »

New Zealand software Rfider tracks coffee from Colombia all the way to New Zealand businesses
Posted 3-Aug-2020 10:35


Logitech G launches Pro X Wireless gaming headset
Posted 3-Aug-2020 10:21


Sony Alpha 7S III provides supreme imaging performance
Posted 3-Aug-2020 10:11


Sony introduces first CFexpress Type A memory card
Posted 3-Aug-2020 10:05


Marsello acquires Goody consolidating online and in-store marketing position
Posted 30-Jul-2020 16:26


Fonterra first major customer for Microsoft's New Zealand datacentre
Posted 30-Jul-2020 08:07


Everything we learnt at the IBM Cloud Forum 2020
Posted 29-Jul-2020 14:45


Dropbox launches native HelloSign workflow and data residency in Australia
Posted 29-Jul-2020 12:48


Spark launches 5G in Palmerston North
Posted 29-Jul-2020 09:50


Lenovo brings speed and smarter features to new 5G mobile gaming phone
Posted 28-Jul-2020 22:00


Withings raises $60 million to enable bridge between patients and healthcare
Posted 28-Jul-2020 21:51


QNAP integrates Catalyst Cloud Object Storage into Hybrid Backup solution
Posted 28-Jul-2020 21:40


Vector and AWS join forces to accelerate the future of energy
Posted 28-Jul-2020 21:35


JBL launches new mobile earbuds and PC speakers
Posted 22-Jul-2020 16:04


Ingram Micro brings virtualisation intelligence to market
Posted 21-Jul-2020 13:25



Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.


Support Geekzone »

Our community of supporters help make Geekzone possible. Click the button below to join them.

Support Geezone on PressPatron



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.