4,009 questions
0
votes
0
answers
57
views
Batch Files sometimes hangs up computer after running when running through MS access M
I run a daily program to convert a pdf to Excel via pdf2xl. Every once in a while the program runs, but the command icon shows it is still running after everything is done. The clock on the computer ...
- 11
0
votes
0
answers
66
views
PySpark to Teradata insert fails with java.sql.BatchUpdateException when using batchsize
I am trying to insert data from HBase into Teradata using PySpark.
The data is read into a Spark DataFrame and inserts successfully when I limit the DataFrame to 3000–5000 rows like this:
df = df....
- 155
0
votes
0
answers
77
views
Using Powershell to change filedates
Short story: saved pictures from phone to computer, preserved last modified date, destroyed created date. So in wanting to restore them to the phone, and preserve the order in which they were made in ...
- 53
0
votes
1
answer
190
views
BadRequestError: model_not_found ==> The provided model deployment 'REPLACE-WITH-MODEL-DEPLOYMENT-NAME' does not exist in the AOAI resource
Issue with Azure OpenAI Batch Processing API
I'm trying to use the batch processing API provided by Azure OpenAI. I followed the official documentation here.
Steps I've taken:
Created an Azure OpenAI ...
1
vote
1
answer
256
views
Multi-Process in deepface (face recognition)
Is there a way to send faces to the find function in parallel in face recognition?
(I want to create a batch processing or multi-processing mode so that I can process multiple faces on the GPU at the ...
- 11
0
votes
0
answers
50
views
Why does torch_geometric.Batch add edge_index, edge_attr and pos to my custom Data even when not set?
I'm using PyTorch Geometric and have a custom Torus class (a subclass of Data) that conditionally initializes attributes such as edge_index, edge_attr, and pos only when no_fixed is False. For example:...
1
vote
1
answer
309
views
My AzureOpenAI batch job shows complete, but only a few rows (not all rows) are completed in the batch file without any error
I have tried uploading a batch job with unique custom_id for each row in my input file. The job gets validated but completes very quickly and once I check the job only 276/4096 (as shown in the ...
1
vote
0
answers
58
views
Google Drive API Batch Upload Fails with Latin-1 Encoding Error, Works Individually
I'm encountering a UnicodeEncodeError: 'latin-1' codec can't encode character '\ufffd' when attempting to upload Excel files to Google Drive using the Google Drive API's batch request functionality. ...
0
votes
1
answer
31
views
Stream data to a model form tensorflow datasets without having it to download locally
I was trying to load the dataset from tensorflow datasets without having it to download locally and process it to a pipeline in batches so i can feed it into my model. I'm not sure if I'm doing it ...
- 9
0
votes
2
answers
102
views
efficient matrix inversion/multiplication with multiple batch dimensions in pytorch
In my framework, I am having an outer loop (here mocked by the variable n) and inside the loop body I have to perform matrix inversions/multiplications for multiple batch dimensions. I observed that ...
- 332
0
votes
1
answer
136
views
How to convert multiple postscript files into PNGs using Ghostscript
I will be processing hundreds of postscript files and converting them into PNG files with Ghostscript, so I am trying to find a way to batch process them in one command.
When doing this manually I ...
- 21
0
votes
0
answers
123
views
Python 3.8 | cx_Oracle 8.3.0 OR python-oracledb | executemany with batcherrors = True not working
I am using python 3.8 and cx_Oracle 8.3.0.
I am using executemany with batcherrors=True but it is not working at all.
executemany is just raising an exception for the error occurred at first place and ...
0
votes
0
answers
49
views
How can I batch process multiple .npy files in Python for motion capture data preprocessing?
I am working on a project where I need to preprocess multiple motion capture files stored in .npy format. I am able to load and preprocess individual files, but I am facing difficulties when trying to ...
0
votes
0
answers
21
views
TypeError: Tuple indices must be integers or slices, not dict
I am trying to add a learning rate scheduler with a finBERT model. However I am getting this error " TypeError: tuple indices must be integers or slices, not dict" while training.
#...
- 1
0
votes
1
answer
55
views
Spring Batch Stop/Start Master Job
I want to run Spring Batch v4 in a multi-JVM instance (each instance on a different machine) and use SQS to distribute the work from master to the worker JVMs (Remote Partitioning) .
Once the master ...
- 383
0
votes
1
answer
179
views
Batch processing multiple excel files in folder via python script and outputting into folder, while ignoring other file types
Each week our inventory reporting software outputs 15+ different inventory reports (one for each vendor respectively) in .xlsx format into one folder.
All the excel sheets are in an identical format ...
0
votes
1
answer
110
views
How to fetch only the coverage results of lines, branches & functions from console in batch scripting in GCOV
gcovr -v -b -r .^
--xml-pretty^
-o ".\reports\publish\coverage.xml"^
--sort-percentage^
-s ^
--exclude=".*(abcd_|_abcd|-xy|xy_|_xy($|\/)|APK_GENERATED).*" || goto :error
When ...
- 1
1
vote
0
answers
22
views
How to arrange Spring Batch chunk processing with online transactions
The system has simultaneous batch jobs and online workflows. Consider batch job retrieving unprocessed documents, marking them as processed in the chunk transaction. Chunk processing is required for ...
- 23.8k
0
votes
2
answers
333
views
Multiprocessing with batching
I'd love to do multiprocessing to speed up the program. My input file contains 30 million rows. I'd love to run 10 processes in parallel. But my file is very large (contains 30 million rows). I'm ...
- 1
0
votes
3
answers
117
views
Batch insertion into multiple tables based on a single result set
I have written a computationally expensive select query which produces a certain result set. I need to insert this result into a table and the aggregates of this result set into another table. I need ...
- 161
0
votes
1
answer
529
views
How to fix "Invalid value for purpose." error when using Azure OpenAI GPT 4o mini batch?
I try to use Azure OpenAI GPT 4o mini batch. I first need to create the batch. I ran:
import os
from openai import AzureOpenAI
client = AzureOpenAI(
api_key="[insert Azure OpenAI API key ...
- 84.7k
0
votes
1
answer
416
views
Spring batch job restart after server crash fails as job registry does not contain job after upgrade to spring batch core jar to 5.12
Spring batch partition job which would have been in STARTED status due to server crash.
Now if we change the status of both job execution and stop from STARTED to FAILED and call jobOperator.restart(...
- 181
2
votes
0
answers
159
views
How to stop the Spring batch gracefully in Spring boot application
I am using Spring batch for my spring boot application. After I schedule the job in the background, i want to stop the job.
I am using following to stop the job
jobOperator.stop(jobId)
Job is going ...
- 6,379
0
votes
1
answer
587
views
Batching inference for llama
I am using llama3.1:8b for answering questions based on given context. Doing this iteratively for 20,000 takes too much time. Is there any batching solution for single gpu?
I am using it through ...
-2
votes
1
answer
99
views
How to use jq in linux for multiple files?
I am trying to convert SAFECAST API JSON to a CSV suitable for spreadsheet programs like Excel etc. to prepare some data summaries etc. I have semi-manual WGET script to download several JSON files ...
- 117