840 questions
-1
votes
1
answer
65
views
How do I clear the cache in Pentaho Data Integration? [closed]
How do you clear the cache for Pentaho in a Linux environment? Is there a particular file I need to delete somewhere?
0
votes
1
answer
41
views
Move files based on size in Pentaho
Within Pentaho, how do I move files from a particular local directory that are 1 KB in size to another folder? Ideally, I'd like to move all 1 KB files at once and not go one by one (we're talking ...
- 719
0
votes
1
answer
159
views
Pentaho Unable to get database metadata from this database connection
We are using Pentaho 9.3.
Pentaho will work fine, but occasionally we will get an error message "Error connection to database [database_name]. Unable to get database metadata from this database ...
0
votes
0
answers
33
views
Pentaho Data Migration Job Running but Not Migrating Data
I am working on optimizing a data migration task using Pentaho 9.4. My job, parallel-mandate-migration, is designed to migrate data in partitions for improved performance. Although the job executes ...
0
votes
0
answers
85
views
Pentaho Data Integration treating empty string as null, "KETTLE_EMPTY_STRING_DIFFERS_FROM_NULL=Y" doesn't work
My Pentaho Data Integration version is 10.2
input table
SELECT * FROM DGKHZZXXB WHERE QUAL_CERT_NM IS NOT NULL
I have filtered QUAL_CERT_NM column is not NULL, and there are some records have empty ...
0
votes
1
answer
111
views
Is Execute SQL script a preferable way to run PL/SQL?
I'm practicing Pentaho Spoon and I have 2 queries that use PL/SQL. The first query joins multiple tables in my Oracle database to calculate a value, then insert the value into a table in the database. ...
- 9
0
votes
1
answer
44
views
Setting a variable in Penatho DI that changes if a file is processed
I am working on a Pentaho job that takes processes and deletes files from an email account and then places the data in a database. The job then loops back to check if there are additional files.
The ...
0
votes
2
answers
71
views
How can I mask all tables for all Transformation in Job?
In my Pentaho Data Integration (PDI) workflows, I need to copy data from Database A to Database B. so I use copy tables function to do it. copy tables function
However, before writing the data to ...
- 1
-1
votes
1
answer
37
views
How to separate lines with a repeated identifier from lines with a non-repeated identifier?
I would like to generate two outputs in Pentaho. One output with lines where the CPF is unique and another output as lines where the CPF is repeated. Initially I used the "Data grid" and &...
- 305
1
vote
0
answers
122
views
How to read an excel file with dynamic column name in Pentaho data integration?
I am new in Pentaho data Integration and I have a request to ingest and excel file with dynamic columns names. The columns names will be added or be deleted every month. We will need to load the data ...
- 11
0
votes
1
answer
174
views
How to write a blob file to local filesystem using PDI?
I have a transformation where I read in a raw application/octet-stream into a stream field using a RESTClient step, which is working correctly. Now, I would like to write the (*.jpg) file to the ...
0
votes
0
answers
141
views
Amazon S3 multi part upload error using Pentaho 9.3
I am trying to upload multiple GZip files to Amazon S3 using Pentaho 9.3. I have also set the part size to maximum in the kettle property but am still facing the S3 multi-part error. Reference for ...
0
votes
1
answer
107
views
Get row number from stream to perform concat
Can we simply extract the row number from stream in Pentaho Spoon to perform a concat operation with it, for example?
Let's consider we have:
#
Country
RowNum
1
FR
null
2
BE
null
Here I want to ...
- 61
0
votes
0
answers
75
views
Troubleshooting 'No such file or directory' Error for Network Paths in Pentaho Server Job Execution
I'm facing an issue with a Pentaho Server job that executes a Python script (Automacao_latromi_relatoriobi_inbound_V4.py). The job fails with a "No such file or directory" error when ...
0
votes
1
answer
303
views
Issue with Channel Log Tables in Pentaho Data Integration V7: Works in Manual Execution but Not in Nightly Batch
In Pentaho Data Integration (V7), we have activated Kettle's own log tables to generate an error reporting system. So far, we have activated the Job, Transformation, and Channel log tables:
In the ...
- 159
0
votes
1
answer
744
views
Pentaho Integration with Java Application
I'm having some trouble integration Pentaho with my Java application. I'm currently using Java 11, and Quarkus 3.X.
My goal is to create an API to trigger the Pentaho job to run. I have the kettle and ...
- 33
0
votes
1
answer
161
views
Disable Pentaho Info Logs
When I kick off Pentaho to run the logs start off like this...
NFO: Lock acquired. Setting startlevel to 100
Jan 20, 2024 7:06:24 PM org.apache.karaf.main.Main$KarafLockCallback lockAcquired
INFO: ...
-3
votes
1
answer
122
views
Regex to check the string from end of the string
I need to select the substring of a text from an given keyword. For example
Str= 'book, painting'
I need to get output like ', painting'
So i gave regular expression like (•*)(\, •*) and collect ...
0
votes
0
answers
424
views
Problems running Pentaho Data Integration Error: Main class not found or loaded
I have a problem, I am trying to run Pentaho Data Integration 9.4 in an Ubuntu 22.04 environment and it installed everything apparently correct, the Virtual Machine 8, and the dependencies that ...
0
votes
1
answer
67
views
Connection between pentaho and mysql is reset
Whenever I'm in the middle of a "big" transformation, at some (random) moment the connection between Pentaho and MySQL is reset and I need to start all over again.
Is there any way to ...
0
votes
2
answers
137
views
Can PDI output multiple Excel files based on Content?
I have a database table that has two columns - date and name.
The date column is in a standard YYYYMMDD format, and the name column is just a set of unique random names.
Assuming the table contains ...
- 660
0
votes
1
answer
617
views
Pentaho metastore location when connecting to repository
I am configuring the repository to work with Pentaho. Currently I have a simple script that creates some Environmental variables (e.g. KETTLE_HOME) and then calls/opens the provided spoon client.
Here ...
0
votes
1
answer
80
views
How to define the loop xpath in Pentaho
<?xml version="1.0" encoding="ISO-8859-1"?>
<ONIXmessage
xmlns="http://www.editeur.org/onix/3.0/short/onix-international.dtd" release="3.0">
...
1
vote
1
answer
107
views
Read VarBinary(Max) using Pentaho ETL Tool
while trying to extract data from sql server where data stored in VarBinary(max) and store it into text file using pentaho ETL Tool. While extracting data getting invalid data which is stored as ...
- 11
0
votes
1
answer
233
views
Fill Previous Values - Pentaho Data Integration
I would like to fill the null values in StoreName with the previous StoreName values. For example the first 7 products are based in the "AKHİSAR" store but the store name is valid for only ...
- 159