Bulk Upload Fails

pgovindrao · October 2, 2014, 5:18am

Posting on behalf of @Amy_Bai

I’m trying to test the BO —register participant. I got wired error. After I Upload Data, 1 record failed. No error message in the downloaded report. (Sorry bother you again, I forgot my user name on forums and had some difficulty to recovery my login.)

Here were my steps:

  Download Template---I chose Register Participants.

```
  Filled columns.
```
```
  Upload Data.
```

Attachment includes the Downloaded file.

I couldn’t find any example files regarding the Upload Data.

createParticipantWithConsents3-2.csv (1.2 KB)

pgovindrao · October 2, 2014, 5:24am

Hi Amy,

I see that the file you uploaded has text in Birthdate - should be a date or blank, cannot be text. Other things to take care of:

The title you have used for CP title should be long title of a protocol existing on your instance
Site name used for MRN should be existing
All dates should be in the format mm-dd-yyyy.

For some of the issues, the BO does not get proper error message. We will handle this in future versions.

Please see attached sample file which worked on demo site.
createParticipantWithConsents3.csv (1019 Bytes)

Thanks,
Poornima

Amy_Bai1 · October 2, 2014, 6:57pm

Thanks Poornima.

I created another account since last one was lost.

Yes, the Create Participant was successful.

I got error when I create collection group.

Is there any guide/example documents which I could follow? I understand it may be a small case sometimes.

I attached file. The Site Name is existed and I used it for create patient without any problem.
Here is error:

14:40:01,781 INFO [STDOUT] Hibernate: select JOB_DETAILS_SEQ.nextval from dual
14:40:01,781 INFO [STDOUT] Hibernate: insert into JOB_DETAILS (JOB_STATUS, LOG_FILE, START_TIME, JOB_STARTED_BY, JOB_NAME, TIME_TAKEN, FAILED_RECORDS_COUNT, TOTAL_RECORDS_COUNT, CURRENT_RE
14:40:01,812 INFO [STDOUT] ERROR 14:40:01,812 (CPRDAO) - PMI details are not correct, no matching CPR found with the given PMI details
14:40:01,812 INFO [STDOUT] ERROR 14:40:01,812 (CPRDAO) - edu.wustl.common.exception.BizLogicException: TestS
14:40:01,812 INFO [STDOUT] ERROR 14:40:01,812 (CaCoreAppServicesDelegator) - Delegate Add–>invalid.site.name
edu.wustl.common.exception.BizLogicException: invalid.site.name
        at edu.wustl.common.bizlogic.AbstractBizLogic.insert(AbstractBizLogic.java:270)
        at edu.wustl.common.bizlogic.AbstractBizLogic.insert(AbstractBizLogic.java:386)
        at edu.wustl.catissuecore.client.CaCoreAppServicesDelegator.delegateAdd(CaCoreAppServicesDelegator.java:157)
        at edu.wustl.catissuecore.client.CaTissueAppServiceImpl.insertObject(CaTissueAppServiceImpl.java:66)
        at edu.wustl.bulkoperator.appservice.AbstractBulkOperationAppService.insert(AbstractBulkOperationAppService.java:71)
        at edu.wustl.bulkoperator.processor.StaticBulkOperationProcessor.process(StaticBulkOperationProcessor.java:90)
        at edu.wustl.bulkoperator.controller.BulkOperationProcessController.processRecord(BulkOperationProcessController.java:171)
        at edu.wustl.bulkoperator.controller.BulkOperationProcessController.process(BulkOperationProcessController.java:96)
        at edu.wustl.bulkoperator.controller.BulkOperationProcessController.handleBulkOperationJob(BulkOperationProcessController.java:64)
        at edu.wustl.bulkoperator.client.BulkOperatorJob.doJob(BulkOperatorJob.java:50)
        at edu.wustl.bulkoperator.jobmanager.AbstractJob.run(AbstractJob.java:104)
        at java.lang.Thread.run(Thread.java:662)
Caused by: edu.wustl.common.exception.BizLogicException: TestS
        at edu.wustl.catissuecore.dao.CPRDAO.getCPRIDByPMI(CPRDAO.java:60)
        at edu.wustl.catissuecore.bizlogic.SpecimenCollectionGroupBizLogic.validate(SpecimenCollectionGroupBizLogic.java:1705)
        at edu.wustl.common.bizlogic.AbstractBizLogic.insert(AbstractBizLogic.java:258)
        … 11 more
14:40:01,827 ERROR [STDERR] edu.wustl.common.exception.BizLogicException: invalid.site.name
14:40:01,827 ERROR [STDERR]     at edu.wustl.common.bizlogic.AbstractBizLogic.insert(AbstractBizLogic.java:270)
14:40:01,827 ERROR [STDERR]     at edu.wustl.common.bizlogic.AbstractBizLogic.insert(AbstractBizLogic.java:386)
14:40:01,827 ERROR [STDERR]     at edu.wustl.catissuecore.client.CaCoreAppServicesDelegator.delegateAdd(CaCoreAppServicesDelegator.java:157)
14:40:01,843 ERROR [STDERR]     at edu.wustl.catissuecore.client.CaTissueAppServiceImpl.insertObject(CaTissueAppServiceImpl.java:66)
14:40:01,843 ERROR [STDERR]     at edu.wustl.bulkoperator.appservice.AbstractBulkOperationAppService.insert(AbstractBulkOperationAppService.java:71)
14:40:01,843 ERROR [STDERR]     at edu.wustl.bulkoperator.processor.StaticBulkOperationProcessor.process(StaticBulkOperationProcessor.java:90)
14:40:01,843 ERROR [STDERR]     at edu.wustl.bulkoperator.controller.BulkOperationProcessController.processRecord(BulkOperationProcessController.java:171)
14:40:01,843 ERROR [STDERR]     at edu.wustl.bulkoperator.controller.BulkOperationProcessController.process(BulkOperationProcessController.java:96)
14:40:01,843 ERROR [STDERR]     at edu.wustl.bulkoperator.controller.BulkOperationProcessController.handleBulkOperationJob(BulkOperationProcessController.java:64)
14:40:01,843 ERROR [STDERR]     at edu.wustl.bulkoperator.client.BulkOperatorJob.doJob(BulkOperatorJob.java:50)
14:40:01,843 ERROR [STDERR]     at edu.wustl.bulkoperator.jobmanager.AbstractJob.run(AbstractJob.java:104)
14:40:01,843 ERROR [STDERR]     at java.lang.Thread.run(Thread.java:662)
14:40:01,843 ERROR [STDERR] Caused by: edu.wustl.common.exception.BizLogicException: TestS
14:40:01,859 ERROR [STDERR]     at edu.wustl.catissuecore.dao.CPRDAO.getCPRIDByPMI(CPRDAO.java:60)
14:40:01,859 ERROR [STDERR]     at edu.wustl.catissuecore.bizlogic.SpecimenCollectionGroupBizLogic.validate(SpecimenCollectionGroupBizLogic.java:1705)

Amy_Bai1 · October 2, 2014, 6:59pm

createSCG13.csv (622 Bytes)

Sonal_Narnaware · October 5, 2014, 7:00pm

Hi @Amy_Bai1,

Checked your uploaded file for SCG . Below are the things to correction:

Clinical diagnosis, clinical status cannot be blank. If no specific value then use ‘Not Specified’
Create anticipated specimen value can either be ‘TRUE’ or ‘FALSE’ and not date
Collected/Received User name should be login names. for e.g. admin@admin.com
Procedure, container, Quality values cannot be blank. If no specific value then use ‘Not Specified’
Collection and received date should be in the format mm-dd-yyyy hh:mm

Other things to take care of:

Site name used for MRN should be existing
SCG Name cannot be blank except if SCG label generation is ON

Please re-try with these changes and let us know how it goes.

Thanks,
Sonal

pgovindrao · October 6, 2014, 11:50am

Hello @Amy_Bai1,

We have created a wiki page for bulk operations tips and tricks, hope this helps - https://catissueplus.atlassian.net/wiki/x/8YD5AQ.

Thanks,
Poornima

Amy_Bai1 · October 9, 2014, 5:33pm

Sonal,
Thanks for pointing all the places where I need correct. This is my first using BO function and the load message always said: 'invalid.site.name ’ which confused me .

I changed all as you mentioned. However I still got ERROR:
invalid.site.name
createSCG23.csv (675 Bytes)

Any idea?

Thanks

Amy

Amy_Bai1 · October 9, 2014, 5:34pm

Thanks Poornima, This site is I’m looking for. Very useful.

Sonal_Narnaware · October 10, 2014, 3:16pm

Hi @Amy_Bai1,

Have checked the SCG file attached. The data looks fine just make sure there exist participant with that MRN and site name in that Collection protocol. Also collection protocol has collection point label with that name as mentioned in the file.

Please let us know if it works

Thanks,
Sonal

Amy_Bai1 · October 13, 2014, 1:12pm

Thanks Sonal,

The Site name in that Collection protocol is correct since I used same name to create the participant. MRN and point label are correct too. However, it didn’t work.

Thanks very much for your help.

Amy

srikanth_adiga · November 10, 2014, 5:16pm

This issue was sorted in an offline call with Amy. Below are the notes:

Had call with Amy, Looked into the SCG creation issue via BO. The problem with the CP title field. The template internally uses the short title and in CSV it is labeled as title. So by specifying the short title, it worked.

Also tried the other templates like create parent specimen, create derivatives. These worked fine.

~Sri