What is "Export CSV Braincube" operation ?
You have to use this type of export for your new databases (except for Azure because of last bug to fix) : updated 18/05/2020.
/!\ This type of export can be used with one condition : your database in Braincube must have the IDMX (Numerical) as Identifier.
The files exported from MX will be named like this (with "col"):
If you have more than 100 000 cells to export, your table will be cut into severals sections with 16 columns in each section. Your files will be named like below. In this example, the table has been cut into 2 parts with 273 files for each one :
If you have only 1 file by treatment cycle, your file will be named "col_xxxxxx_0_0_last.txt".
This new export is linked to an external importation service to Braincube ; you will not be able to follow your files in the "Importation files" menu :
Where do the exported files go ?
With this export, files go in the importation directory to be treated. If there is a problem with a file, it is stored in the retention directory with the file "error" associated that contains the explanation of the error.
To know if some files are blocked in importation or retention, we have alerts in Braincube monitoring :
Files present in the importation or retention directories can be displayed because of a terminal.
- For Maxnod customer ==> in "/home/importation" and "/home/retention"
- For Azure ==> in the "/data/.../importation" and "/data/.../retention" (... : customer name)
=> Files blocked in the retention directory can be moved to importation in order to be treated once again (you have to ask your sysadmin)
If you want to know if the importation service is running, you can look at the logs in the braincube terminal.
For a Maxnod's Braincube, type the following command :
cd /var/log/braindata-importation-service/then
cat braindata-importation-service-0.log
For an Azure's Braincube , type the following command once you are on the right docker :
cd /data/.../log/importation/then
cat braindata-importation-service-0.log
You just have to look at the last log and compare its date to the current date of the server :
If the service is not running (no log), you have to restart the braincube (importation service will be restarted at the same time).
If you want to check the datetime of the file importation, type the following command for all Braincube:
grep ImportEventLogListener braindata-importation-service-0.log | tail -5
In this example you'll have the 5 last logs concerning files importation
From "Export CSV" to "Export CSV Braincube"
To switch from the Export CSV to the Export CSV Braincube, you have to :
- First, stop the Export CSV of your table : you can put it on "No variables" for example, this way the treatment of the data is not stopped
- Wait that all files (linked to your database) are Imported or Partially imported in "Importation files"
- Change the type of the export :
- Start the Export CSV Braincube (change "No variables" chosen in the first step into "All variables")