Previous page | Data Integration | Next page |
Data Import - XML & CSV |
This section documents the various methods used to integrate with other system, for importing and exporting data, either on an ad-hoc/one-off basis, or for more automated synchronisation. Data is normally held within the system in Tables. The mechanisms described import data into the Tables, or export the data from them, using industry standard protocols.
Data ImportImports:CSV, XML, RSS, & Atom feeds When to use:To import structured data from other servers into one or more Tables, for one-off transfer, ad-hoc queries, or for periodic synchronisation. This is the most powerful method for inter-server integration. Scheduling:Imports can be scheduled. Notable features:Can authenticate with secure feeds, handle failover urls, import into multiple tables, and trigger further lookups from separate feeds. It can be triggered by a user making a search. It can suppress making a lookup if the information is already in a Table. XML Data ConnectionThe Data Import Component component provides a powerful interface to pull data into an application from XML sources. CSV Data ImportThe same Data Import Component component provides a comprehensive interface to manage CSV format data exported from other applications. Data Import ComponentExternal Lookup Data Feed Capabilities and Configuration: Read more... Summary of component capabilities See also:
Bulk Import ScriptBulk import of data from the common CSV data export/interchange format using a script. Imports:CSV files When to use:If your data is in a CSV file, and you have easy access to run operating system commands on the server running neatComponents Scheduling:This is designed for ad-hoc / one-off imports. (However you can schedule repeat imports using external operating system level scheduling tools) Notable features:It can see into zip files without you having to extract them. So if you need to import a large collection of images, you can upload a single zip file, and configure the script to iterate through all the files in it. Read more:Configuration documentation CSV ViewThe CSV view is provided to enable Data Export 'on demand' simply by loading the page. Exports:CSV files When to use:To produce CSV files for use in third party applications: databases and spreadsheets. Scheduling:This is designed for ad-hoc usage. CSV reports are built in real-time in response to an HTTP request. For example: http://www.example.com/datasource-page?action=download will download the first CSV view on the page with the DirectURL of /datasource-page. A third party tool, or the receiving application could be scheduled to request the file. Display on page If you do not put You will 'display' the CSV content in the context of an HTML page - so you can see the output.
Example:To deliver an exported CSV: set up another page to do a redirect to the page with the CSV view embed on it, with the ?download=true as part of the redirect.
RSS ViewExports:RSS feed When to use:To produce RSS feeds for feed readers, or to synchronise data from one site with another. Scheduling:This is designed for scheduled access. Reports are cached once generated, and regenerated when their time-to-live has expired. This allows the feed to respond to heavy request load without overburdening the server. A third party tool could be scheduled to request file. |