[Logo] SpagoWorld Forums
  [Search] Search   [Recent Topics] Recent Topics   [Hottest Topics] Hottest Topics   [Members]  Member Listing  
[Groups] Back to home page  [Moderation Log] Moderation Log   [Register] Register /  [Login] Login 
Using Talend throug SpagoBI  XML
Forum Index » Technical Help - SpagoBI Server - ETL
Author Message
rloukil.spw

Newby

Joined: 26/02/2013 19:53:45
Messages: 18
Offline

Hello,
I'm using SpagoBI 3.6 but I didn't find the way to use Talend through SpagoBI.
Thank you for your help.
terje.spw

Newby
[Avatar]

Joined: 05/06/2012 15:19:35
Messages: 18
Location: Oslo, Norway
Offline

Hi, This is as far as I have got:

1. Use TOS/DI version 5.1 with SpagoBI 3.6

2. Set up your SpagoBI-server in TOS/DI (in Preferences-> Talend)

Here is the documentation from Talend to do this:

https://help.talend.com/display/TALENDOPENSTUDIOFORDATAINTEGRATIONUSERGUIDE52EN/5.7.1+How+to+deploy+a+Job+on+SpagoBI+server

3. Create your job in TOS and right-click on the job title and select "Deploy on SpagoBI".

4. Find your job in the SpagoBI server here: PATH_TO_SERVER/repository/java/your_project_name/your_job_name

5. Download or copy the contents of this file in your job folder on the server: spagobi.xml

6. Create a new document on the server from the menu: Analytical model -> Documents development. (Click the green +-sign and magnifier icon in the upper right corner)

7. Select type -> ETL Process and select the downloaded spagobi.xml file as the document template. Choose a folder for saving.

8. Go to the folder where your saved the ETL-document and execute it.


When I figure out how to schedule ETL document execution I will let you know :)
[WWW]
terje.spw

Newby
[Avatar]

Joined: 05/06/2012 15:19:35
Messages: 18
Location: Oslo, Norway
Offline

The trick to scheduling the job is to make sure the document status is set to "Released" - then you can use the web interface document scheduler, which is quite simple and nice :)
[WWW]
rloukil.spw

Newby

Joined: 26/02/2013 19:53:45
Messages: 18
Offline

Hello,
First I want to thank you for your reply.
But there I blocked from step 5.
I would be grateful if you can provide me with more explanation.
Thank you.
terje.spw

Newby
[Avatar]

Joined: 05/06/2012 15:19:35
Messages: 18
Location: Oslo, Norway
Offline

5. Download or copy the contents of this file in your job folder on the server: spagobi.xml

For example, I have made a Talend Project called Terje (my first name). Under this project I have created a job called SugarETL, where I transfer opportunities from SugarCRM to a datawarehouse. I have deployed this job on the SpagoBI server.

When Talend deploys the job, it copies some files to a directory on the SpagoBI server. In my case, the files will be found here:

/home/terje/SpagoBI-demo/repository/java/Terje/SugarETL

One of these files is called: spagobi.xml

The content of this file in my case is this:


<?xml version="1.0" encoding="UTF-8"?>
<etl>
<job context="Default" jobName="SugarETL" language="java" project="Terje"/>
</etl>


I can download this file using scp/sftp or ftp, or open it on the server using e.g. vim (or any text based editor) and copy the file content to memory and then creating a new file on my own pc called e.g. SugarET.xml and paste the contents into this file. This, then, is the file that I will upload as a template file later on, when creating a new ETL document on the server.

I guess the format of this file is the same for all jobs, so you could also just use the text above and substitute your project name and job name :)

I hope this was clearer (?)


This message was edited 3 times. Last update was at 15/04/2013 16:42:59

[WWW]
rloukil.spw

Newby

Joined: 26/02/2013 19:53:45
Messages: 18
Offline

I did the same steps , but when I try to create a new document I found this error "Missing insert path"

terje.spw

Newby
[Avatar]

Joined: 05/06/2012 15:19:35
Messages: 18
Location: Oslo, Norway
Offline

Ah, I see - I don't really know what that can be - maybe some of the excellent SpagoBI engineers will know?

[WWW]
rloukil.spw

Newby

Joined: 26/02/2013 19:53:45
Messages: 18
Offline

I really don't know but can you help to make a cube olap under Spagobi??
rloukil.spw

Newby

Joined: 26/02/2013 19:53:45
Messages: 18
Offline

I resolved the error mentionned before but I found another one while executing the ETL document "Error while executing job."
do you have any idea about this??
sholikhin.spw

Newby

Joined: 04/10/2013 05:01:47
Messages: 49
Offline

terje.spw wrote:Hi, This is as far as I have got:

1. Use TOS/DI version 5.1 with SpagoBI 3.6

2. Set up your SpagoBI-server in TOS/DI (in Preferences-> Talend)

Here is the documentation from Talend to do this:

https://help.talend.com/display/TALENDOPENSTUDIOFORDATAINTEGRATIONUSERGUIDE52EN/5.7.1+How+to+deploy+a+Job+on+SpagoBI+server

3. Create your job in TOS and right-click on the job title and select "Deploy on SpagoBI".

4. Find your job in the SpagoBI server here: PATH_TO_SERVER/repository/java/your_project_name/your_job_name

5. Download or copy the contents of this file in your job folder on the server: spagobi.xml

6. Create a new document on the server from the menu: Analytical model -> Documents development. (Click the green +-sign and magnifier icon in the upper right corner)

7. Select type -> ETL Process and select the downloaded spagobi.xml file as the document template. Choose a folder for saving.

8. Go to the folder where your saved the ETL-document and execute it.


When I figure out how to schedule ETL document execution I will let you know :)


I am using spagobi 4, talend 5.3, and just followed those steps but nothing happened (no error in the log, but destination table is not created & not populated with data from source table). At first, I got an error "Organization not set!!!" but after applying the work around here (http://www.spagoworld.org/jira/browse/SPAGOBI-1074) the error completely gone. The page says "etl.process.started", but nothing happened in the process.

I'm sure that the ETL job is fully functional, work as expected if launched directly from talend.
What am i probably missing here ?. Is there any compatibility issue between talend & spago 4 ?

thanks in advance for your help


guillaume@altic.spw

SpagoBI supporter

Joined: 13/03/2012 10:19:10
Messages: 103
Offline

Hello,

Did you check if your job had done what it should to have to do ? I think "etl.process.started" means job is started but I do not think Talend warns SpagoBI when it ends so you will keep have this message forever. Have you also check your logs ?
tibco29.spw



Joined: 05/03/2014 10:18:18
Messages: 4
Offline

Hi Friends,
I am also sticking with this issue("etl.process.started") and I am using Talend5.4 and SpagoBI4.1.
I have checked log files as well(spagibi.log and SpagoBITalendEngine.log),but notgnig was there, If you fix this issue please post any one.
(My task is simple etl load table from Mysql to sql server and it's working fine in Talend design environment).

I really advance appreciation to keep running this thread.
guillaume@altic.spw

SpagoBI supporter

Joined: 13/03/2012 10:19:10
Messages: 103
Offline

Hello,

Have you checked if your data was loaded in your SQLServer table ?
tibco29.spw



Joined: 05/03/2014 10:18:18
Messages: 4
Offline

yes, I have checked but data not yet loaded in my data base.
guillaume@altic.spw

SpagoBI supporter

Joined: 13/03/2012 10:19:10
Messages: 103
Offline

You could turn log to DEBUG for TalendEngine webapps. You will have logs from Talend himself. I think tLogRow are printed in DEBUG.
 
Forum Index » Technical Help - SpagoBI Server - ETL
Go to:   
Powered by JForum 2.1.9 © JForum Team