839 questions
-1
votes
1
answer
151
views
Loading flat file into temporary SQL Server table
I'm attempting to use a temporary SQL Server table ##temptable to preprocess imported data from flat .csv files.
I created the temporary table in the first step of the control flow, calling a stored ...
- 47
0
votes
0
answers
56
views
Write/convert the oracle data to Json format using SSIS
using (XmlWriter writer = XmlWriter.Create(manifestFilePath, new XmlWriterSettings { Indent = true }))
{
writer.WriteStartDocument();
writer.WriteStartElement("manifest"...
0
votes
2
answers
84
views
PySpark equivalent of Spark sliding() function
I have a multiline flat file which I wish to convert to an rdd/dataframe as a 4 column dataframe, or rdd array via PySpark. The Spark Scala code is,
#from pyspark.sql import SparkSession # Scala ...
- 636
0
votes
0
answers
55
views
ssis ragged right with whitespace delimiter
Working with legacy software which generates files. This one is a ragged right file that is also fixed width, except since the last line doesn't have the delimiter it's 2 characters short and the last ...
- 309
0
votes
1
answer
103
views
Handling inconsistent record delimeters in ssis
I have a "fun" flat file I need to import. It's mostly fixed width with every record consisting of 516 characters, except the last record is only 514 and when importing as fixed width it ...
- 309
1
vote
1
answer
94
views
Building a tree structure JSON from flat file with JS
So I am pretty new with JS and using loops to get data formatted in a JSON tree from a flat file.
I am trying to build an SAP UI5 app and load the data into a tree table.
I have this data
roles: [
...
- 13
0
votes
0
answers
58
views
Can I connect multiple times to the same csv file via ODBC
We have some proprietary software that processes print files (AFP) and within the scripting for a process it makes a call to a SQL server via ODBC once per page in the file. This might mean something ...
- 81
-1
votes
2
answers
60
views
Creating an alias in python for importing excel flat files
I am using the following code to import a xlsx flat file:
master = pd.read_excel("H:/Python_data/profit_US_07 2023.xlsx",skiprows=[0])
I would like to create an alias called infile_nyc ...
- 1
0
votes
1
answer
240
views
parse one segment out of all in flat file to JSON in mule
I want to read a fixed width response from server.
Sample Response
PQRSBNGL1234567890AAHG
Here is sample ffd file
form: COPYBOOK
values:
- name: 'HOSPITALS'
values:
- name: 'BASIC-INFO'
...
0
votes
1
answer
2k
views
Azure Data Studio does not properly import CSV
Please would you help me out with this error.
I am trying to import a csv file through the wizard, downloaded here https://ourworldindata.org/covid-deaths.
But unfortunately it is not converting all ...
- 11
0
votes
0
answers
320
views
SSIS "Execute Package task" in a "for each file" loop failed when loading large number of small files
I have a SSIS package including an "Execute Package Task" (ExecuteOutOfProcess = False) to be executed as many times as there are files in a specific folder.
enter image description here
...
- 3
0
votes
0
answers
544
views
How to read JSON data from flat file in Informatica cloud platform?
I have a flat file(.txt) generated from a web service having the contents something as below:
Field1 Field2
""key1": [{"somekey":"somevalue"}], "key2&...
- 162
0
votes
1
answer
368
views
create Fixed Width File in Python
The code below creates one line of string. My problem is i have a big database. From which i have to create a fixed width text file. Which should post multiple lines
And below code example only posts ...
0
votes
0
answers
127
views
Load flat file data to SQL - when calling from a job, no or few records commit without error, when running manually from solution, it works
I'm perplexed and would appreciate any help. My SQL setup works by jobs running throughout the day that will upload flat file information if the flat file exists. This is setup using variables and ...
0
votes
3
answers
452
views
SSIS Script howto append text to end of each row in flat file?
I currently have a flat file with around 1million rows.
I need to add a text string to the end of each row in the file.
I've been trying to adapt the following code but not having any success :-
...
- 71
0
votes
1
answer
25
views
is a flat file imported into Ocacle never going to be relational?
I imported a csv flat file into Oracle via IICS. I did this with the intention of running a router function in IICS on the newly created Oracle table, to route rows with different data to different ...
- 17
0
votes
1
answer
637
views
FlatFile schema creation "out of order segment" error in mule 4
I am trying to parse a huge flat file into flat file schema, from a file if 3 rows contains tag value "2" then it should pick all three rows at a time but in my case, am unable to pick those ...
- 19
1
vote
1
answer
856
views
How to parse Flat File Schema to mulesoft object
I have requirement where I need to parse MuleSoft Flat File Schema to parse incoming file content, input file row to parse it and convert to Mule object. It should include parsing of multiple rows in ...
- 19
1
vote
1
answer
2k
views
Google Sheets to transform a table into a nested tree to use Tree Map Chart
Trying to transform at flat data format to a nested tree so that i can systematically create a Tree Map chart. There is a similar post, but it stops at a 2 tier tree and I'd like to solve this for an ...
- 21
0
votes
1
answer
53
views
How to assign colours for the data from text file so that the background cell of the data have different colors?
Image of the table created
I want data to have different colour background cells. How to assign colours for the data so that the background cell of the data have different colours
This is the content ...
1
vote
2
answers
188
views
Can you delimit rows and columns by pipe in SSIS?
From SSIS, I need to send an Excel file in the format of;
656265 | 56280212 ||
654581 | 56246894 ||
656111 | 56281475 ||
I currently have a package that generates an Excel file to be displayed as;
...
0
votes
0
answers
137
views
SSIS column skew-SSIS is concatenated to next column value to the current column when it finds the text deliminator in the column value itself
I have a ssis package which gets data from sql and dumps to CSV file.
There are half a million of rows and almost 100 columns and when i dump the data to Flat file destination, some of the column ...
- 151
0
votes
2
answers
64
views
How to reshape flat data from SOAM result by R or Bash?
I use SOAP to extract data from the BRENDA enzyme. After extracting I get the following flat data type:
ecNumber3.2.1.23#piValue6.9!ecNumber3.2.1.23#piValue7.1!ecNumber4.4.1.14#piValue6
And I want ...
- 195
0
votes
1
answer
79
views
oracle insert o into timestamp column
I am having a csv file which contains 0 in timestamp column in source , when it is being inserted into oracle through informatica it is populated as NULL values. I am not sure whether this is correct ....
1
vote
1
answer
598
views
Informatica Flat File source name
I am working on a project were we need to load flat file eg : (Gemstone_20220325.csv) I have given the source name as (Gemstone_*.csv) in script to search for the file in the path.
But it is failing ...