{"info":{"_postman_id":"0396aedd-a176-4dc7-9082-262894bb45b7","name":"LetsData Control SDK API","description":"

LetsData Control SDK

This is the guide for LetsData Control SDK. Control SDK has APIs for creation and management of the APIs to create datasets, update code, list tasks, logs, metrics, errors and usage records etc. You'll use the Control SDK to orchestrate the data pipelines (how to create and manage a datasets / data processing jobs). The Data SDK, on the other hand, is the interface for the user's code that needs to executed for data processing. (Data SDK Docs are at this link)

Here is a list of the different resources and actions that are supported by the LetsData Control SDK API:

Datasets

dataset
- view a dataset
\n
dataset/create
- create a dataset
\n
dataset/list
- list all datasets
\n
dataset/delete
- delete a dataset
- view the status of a delete request
\n
dataset/code
- update (update code jar)
- view (view status of existing update code request)
\n
dataset/compute
- update (update dataset compute config)
\n

Tasks

tasks/list
- list tasks for a dataset
\n
tasks/redrive
- create (create a dataset task redrive request)
- view (view the status of a dataset task redrive request)
\n
tasks/stop
- create (create a dataset task stop request)
\n

Errors

errors
- view an error record file
\n
errors/list

Logs

logs
- view a task's log file
\n

Metrics

metrics
- view a dataset's metrics
\n

VPC

vpc
- list vpcs for a dataset
\n
vpc/listvpcpeeringconnection
- list vpc peering connections for a dataset's vpc
\n
vpc/deletevpcpeeringconnection
- delete vpc peering connections for a dataset's vpc
\n
vpc/acceptvpcpeeringconnection
- accept vpc peering connection for a dataset's vpc
\n

Users

users
- view a user's detail
\n
users/create
- create a user
\n
users/update
- update a user's details
\n
users/delete
- delete a user
\n
users/list
- list the users
\n

Costs

costs
- list the costs for a tenant user
\n

Usage Records

usagerecords/list
- list the usage records for a dataset
\n

Prequisites

To start using the LetsData Control SDK, you need to:

Have a valid LetsData account (username and a password). You can sign-up for a LetsData account at: https://www.letsdata.io/#signup
\n
For any serious calls, you'll need a valid Client Id to use the LetsData Control SDK. You can request one by emailing at support@letsdata.io or logging an issue at https://www.letsdata.io/#support - we'll enable Control API access for your tenant. For any testing and experimentation, you can use the testing and experimentation clientId 6ent0fqtc4v5ud6i8o41ado8rj. Being a multi tenant system, the clientId helps us differentiate API calls from different clients.
\n
Currently there are no API usage rate limits and restrictions.
\n

Authentication

You'll need to obtain AccessToken and IdToken by calling AWS Cognito. Here is a sample request and response:

Post data saved in fileauth_data.json

{\n    \"AuthParameters\" : {\n        \"USERNAME\" : \"{{LetsData Username}}\",\n        \"PASSWORD\" : \"{{LetsData Password}}\"\n    },\n    \"AuthFlow\" : \"USER_PASSWORD_AUTH\", \n    \"ClientId\" : \"{{LetsData ClientId}}\"\n}\n\n

Post request

curl -X POST --data @auth_data.json \\\n    -H 'X-Amz-Target: AWSCognitoIdentityProviderService.InitiateAuth' \\\n    -H 'Content-Type: application/x-amz-json-1.1' \\\n    https://cognito-idp.us-east-1.amazonaws.com/ \\\n    --output creds.json\n\n

Example response is saved in the creds.json - a quick cat creds.json show the following json - copy the AccessToken and IdToken, you'll need these for API calls. Also note the expiry which is the duration the token is valid for.

{\n  \"AuthenticationResult\": {\n    \"AccessToken\": \"eyJraWQiOiJaQk...<redacted>\",\n    \"ExpiresIn\": 3600,\n    \"IdToken\": \"eyJraWQiOiJuSktcL1JN...<redacted>\",\n    \"RefreshToken\": \"eyJjdHkiOiJKV1Qi...<redacted>\",\n    \"TokenType\": \"Bearer\"\n  },\n  \"ChallengeParameters\": {}\n}\n\n

You can call any of the LetsData Control SDK API by adding the -H \"Authorization: Bearer IdToken\" and -H \"LetsDataAuthorization: Bearer AccessToken\" headers. Here is an example API call that does a GET to retrieve a dataset's details.

curl \"https://www.letsdata.io/api/dataset?tenantId={{tenantId}}&userId={{userId}}&datasetName={{datasetName}}\" \\\n    -H \"Authorization: Bearer IdToken\" \\\n    -H \"LetsDataAuthorization: Bearer AccessToken\"\n\n

Almost every Control SDK API requires the tenantId and the userId for the authenticated user (TenantAdmins can pass a different userId to retrieve data for other users in the organization - see user roles documentation). You can find your tenantId, userId via the console, cli (docs) or decode the IdToken to get the tenant and user ids (jwt.io has a decoder). Here is a decoded Id token - the sub field is the userId and the custom:tenantid is the tenantId

{\n  \"sub\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n  \"custom:companyaddress\": \"{\\\"addressLine1\\\":\\\"1234 Some Street\\\",\\\"addressLine2\\\":\\\"Apt F8\\\",\\\"city\\\":\\\"Bellevue\\\",\\\"state\\\":\\\"WA\\\",\\\"country\\\":\\\"US\\\",\\\"postalCode\\\":\\\"98006\\\"}\",\n  \"cognito:groups\": [\n    \"Tenant-d5feaf90-71a9-41ee-b1b9-35e4242c3155-Users\"\n  ],\n  \"custom:userrole\": \"TenantAdmin\",\n  \"iss\": \"https://cognito-idp.us-east-1.amazonaws.com/us-east-1_asdjery68Ts\",\n  \"cognito:username\": \"user@letsdata.io\",\n  \"custom:companyname\": \"LetsData IO\",\n  \"origin_jti\": \"1a0038a2-f8dd-4a71-996e-e64cde31003c\",\n  \"custom:tenantid\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n  \"aud\": \"11bbm85f3niuukca8su98dqc2t\",\n  \"event_id\": \"978d2a81-fa94-4fdf-a5ce-52240c02aaaa\",\n  \"token_use\": \"id\",\n  \"auth_time\": 1708220818,\n  \"exp\": 1708224418,\n  \"iat\": 1708220818,\n  \"jti\": \"194095f3-f350-425b-ad84-c5f8e1dd67fc\",\n  \"email\": \"user@letsdata.io\"\n}\n\n

API Common Errors

Here are common errors for the API that you may see from time to time and an explanation of what they mean:

HTTP 401 Unauthorized

If the request could not be authorized, you will receive an HTTP 401 Unauthorized response code. The response body will have the following JSON:

{\n    \"statusCode\": \"{{LETSDATA_STATUS_CODE}}\",\n    \"message\": \"{{LETSDATA_ERROR_MESSAGE}}\"\n}\n\n

The following status codes / messages are expected

LETSDATA_ACCESS_TOKEN_UNAUTHORIZED: AWS Cognito was unable to verify the access token, so some parameter is possibly wrong in the auth request, expired token etc.

{\n    \"statusCode\": \"LETSDATA_ACCESS_TOKEN_UNAUTHORIZED\",\n    \"message\": \"The access token in the request is unauthorized to view this resource.\"\n}\n\n

UNAUTHORIZED: LetsData could not authenticate / authorize the request, some validation check failed. These could be different tenantId in request data and id token, different userIds, incorrect clientId, expired token or incorrect user role (user roles docs) similar.

{\n    \"statusCode\": \"UNAUTHORIZED\",\n    \"message\": \"The user is unauthorized to view this resource.\"\n}\n\n

HTTP 404 NotFound

HTTP 404 can be returned when the resource could not be found. Also, if the Http verb is different (for example GET was issued but the code requires a POST), you'll also see Http 404 NotFound response with the following body \"Unsupported Http Method. Expected HttpMethod: POST, Actual HttpMethod: GET\"

\n","schema":"https://schema.getpostman.com/json/collection/v2.0.0/collection.json","toc":[{"content":"LetsData Control SDK","slug":"letsdata-control-sdk"},{"content":"Prequisites","slug":"prequisites"},{"content":"Authentication","slug":"authentication"},{"content":"API Common Errors","slug":"api-common-errors"}],"owner":"33034393","collectionId":"0396aedd-a176-4dc7-9082-262894bb45b7","publishedId":"2sA2xh3D7y","public":true,"customColor":{"top-bar":"FFFFFF","right-sidebar":"303030","highlight":"FF6C37"},"publishDate":"2024-03-09T21:59:27.000Z"},"item":[{"name":"dataset","item":[{"name":"list","item":[{"name":"List Datasets","id":"ca726b6c-8789-4ef4-b316-0376de967185","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/dataset/list?userId=userId&tenantId=tenantId","description":"

dataset/list

The listing of the datasets created by the user can be obtained by using the dataset/list GET API. This returns a list of the dataset configuration details json and an optional next token to paginate the next page. The list command also supports a few different useful filters that can be used to filter the results. We'd look at these in 'Input Parameters' section.

Input Parameters:

tenantId: The tenantId of the logged in user.
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For example, &userId=078260ed-3124-4de0-8eee-cc5b5025e7ad to list datasets created by user 078260ed-3124-4de0-8eee-cc5b5025e7ad (user is a different user in the same Tenant / Organization)
datasetNamePrefix: [Optional] Filter the results by returning datasets whose datasetName is equal to the CLI input datasetNamePrefix. For example, &datasetNamePrefix=IndexWebCrawlData to list datasets whose name starts with the prefix IndexWebCrawlData
datasetStatus: [Optional] Filter the results by returning results whose datasetStatus is equal to the the given datasetStatus, where the datasetStatus needs to be from the datasetStatus set: [CREATED, INITIALIZING, PROCESSING, COMPLETED, ERRORED, DESCALED, FROZEN, DELETED, UPDATING, REDRIVING, STOPPING_ERROR, STOPPING_COMPLETE, DESCALING, FREEZING, DELETING]. For example, &datasetStatus=DELETED to list deleted datasets.
limit: [Optional] The limit for the number of results that are to be returned by the command. This is used in conjunction with pagination when large number of records are being retrieved. This is optional and the system does set some meaningful defaults in most APIs. Also, this limit is a hint for the API and the results are not guaranteed to be exactly the same number as the limit. The user needs to handle the following cases when specifying limits (Rule of thumb in using limits is to treat it as a soft max limit) :
- The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved.
- The records may be a little more than the limit (\\~<10 or so). User should handle these gracefully.
\n
next: [Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved. For example, &next =x3m2D9SduUj6...
forward: [Optional] When the next token is specified for pagination, the same token can be used to retrieve the next page or the previous page by specifying this boolean parameter. &forward=true fetches the next page, &forward=false fetches the previous page. For example, &forward=false&next=x3m2D9SduUj6...

Output Parameters:

The output is a JSON map that has the following sections:

{\n    \"datasets\": [\n      {\n        ...\n      },\n      {\n        ...\n      },\n      ...\n    ],\n    \"next\": \"String\"\n}\n\n

datasets: This is the list of dataset json documents that are returned by the list command. These have details about the read, write and error connectors, the manifest file, the compute engine, access grants and system's internal details about the datasetStatus, progress and execution logs. Details about Datasets can be found at: https://www.letsdata.io/docs#datasets
next: [Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved.

Actual Example Output:

Here is an actual example output for the command:

{\n  \"datasets\": [\n    {\n      \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/LetsData_AccessRole_IndexWebCrawlDataOct2022\",\n      \"computeEngine\": {\n        \"computeEngineType\": \"LAMBDA\",\n        \"concurrency\": 500,\n        \"memoryLimitInMegabytes\": 10240,\n        \"timeoutInSeconds\": 300\n      },\n      \"createDatetime\": 1670016520269,\n      \"customerAccountForAccess\": null,\n      \"datasetId\": \"68d2ab6251a55b1264d90cb68f64be2a\",\n      \"datasetName\": \"IndexWebCrawlDataOct2022\",\n      \"region\": \"us-east-1\",\n      \"datasetProgress\": {\n        \"completedTasks\": 69675,\n        \"errorTasks\": 3545,\n        \"totalTasks\": 80000\n      },\n      \"datasetStatus\": \"PROCESSING\",\n      \"errorConnector\": {\n        \"bucketName\": \"tldec3cf80d1c22e77d5c03355b732766ccb5\",\n        \"connectorDestination\": \"S3\",\n        \"resourceLocation\": \"LetsData\"\n      },\n      \"executionLogs\": [\n        {\n          \"endDatetime\": null,\n          \"startDatetime\": 1670018366085\n        }\n      ],\n      \"manifestFile\": {\n        \"fileTypes\": [\n          \"WARC\",\n          \"WET\",\n          \"WAT\"\n        ],\n        \"manifestFileS3Uri\": \"s3://resonancemanifestfile/resonance_manifest_full.txt\",\n        \"manifestFileS3UriIsPublic\": false,\n        \"manifestType\": \"S3ReaderS3LinkManifestFile\",\n        \"readerType\": \"MULTIPLEFILESTATEMACHINEREADER\"\n      },\n      \"readConnector\": {\n        \"artifactFileS3Link\": \"s3://indexwebcrawl-jar/index-web-crawl-1.0-SNAPSHOT.jar\",\n        \"artifactFileS3LinkIsPublic\": false,\n        \"bucketName\": \"commoncrawl\",\n        \"connectorDestination\": \"S3\",\n        \"implementationLanguage\": \"JAVA\",\n        \"isBucketPublic\": true,\n        \"numberOfReaderFileTypes\": 3,\n        \"readerFileTypeImplementationClassNameMap\": {\n          \"WARC\": \"com.indexwebcrawl.parser.WARCFileParser\",\n          \"WAT\": \"com.indexwebcrawl.parser.WATFileParser\",\n          \"WET\": \"com.indexwebcrawl.parser.WETFileParser\"\n        },\n        \"readerFileTypeSet\": [\n          \"WARC\",\n          \"WET\",\n          \"WAT\"\n        ],\n        \"readerType\": \"MULTIPLEFILESTATEMACHINEREADER\"\n      },\n      \"tenantId\": \"e7148bad-2415-4a61-9189-7ad14ea5a212\",\n      \"updateDatetime\": 1670193359009,\n      \"userId\": \"aa072857-ef58-4703-97e1-4c1f455e2c0c\",\n      \"writeConnector\": {\n        \"connectorDestination\": \"KINESIS\",\n        \"kinesisShardCount\": 100,\n        \"kinesisStreamName\": \"tldwc3cf80d1c22e77d5c03355b732766ccb5\",\n        \"resourceLocation\": \"LetsData\"\n      }\n    },\n    {\n      \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/LetsData_AccessRole_IndexWebCrawlDataOct2022\",\n      \"computeEngine\": {\n        \"computeEngineType\": \"LAMBDA\",\n        \"concurrency\": 15,\n        \"memoryLimitInMegabytes\": 10240,\n        \"timeoutInSeconds\": 300\n      },\n      \"createDatetime\": 1670011188150,\n      \"customerAccountForAccess\": null,\n      \"datasetId\": \"2dadaa24bb08026a4451bb995ffaafcf\",\n      \"datasetName\": \"IndexWebCrawlDataOct2022Subset1\",\n      \"region\": \"us-east-1\",\n      \"datasetProgress\": {\n        \"completedTasks\": 5,\n        \"errorTasks\": 0,\n        \"totalTasks\": 5\n      },\n      \"datasetStatus\": \"FROZEN\",\n      \"errorConnector\": {\n        \"bucketName\": \"tldec60927c5ba114ca1b520a4950e9734b68\",\n        \"connectorDestination\": \"S3\",\n        \"resourceLocation\": \"LetsData\"\n      },\n      \"executionLogs\": [\n        {\n          \"endDatetime\": 1670011747951,\n          \"startDatetime\": 1670011459087\n        }\n      ],\n      \"manifestFile\": {\n        \"fileTypes\": [\n          \"WARC\",\n          \"WET\",\n          \"WAT\"\n        ],\n        \"manifestFileS3Uri\": \"s3://resonancemanifestfile/resonance_manifest_full_test.txt\",\n        \"manifestFileS3UriIsPublic\": false,\n        \"manifestType\": \"S3ReaderS3LinkManifestFile\",\n        \"readerType\": \"MULTIPLEFILESTATEMACHINEREADER\"\n      },\n      \"readConnector\": {\n        \"artifactFileS3Link\": \"s3://indexwebcrawl-jar/index-web-crawl-1.0-SNAPSHOT.jar\",\n        \"artifactFileS3LinkIsPublic\": false,\n        \"bucketName\": \"commoncrawl\",\n        \"connectorDestination\": \"S3\",\n        \"implementationLanguage\": \"JAVA\",\n        \"isBucketPublic\": true,\n        \"numberOfReaderFileTypes\": 3,\n        \"readerFileTypeImplementationClassNameMap\": {\n          \"WARC\": \"com.indexwebcrawl.parser.WARCFileParser\",\n          \"WAT\": \"com.indexwebcrawl.parser.WATFileParser\",\n          \"WET\": \"com.indexwebcrawl.parser.WETFileParser\"\n        },\n        \"readerFileTypeSet\": [\n          \"WARC\",\n          \"WET\",\n          \"WAT\"\n        ],\n        \"readerType\": \"MULTIPLEFILESTATEMACHINEREADER\"\n      },\n      \"tenantId\": \"e7148bad-2415-4a61-9189-7ad14ea5a212\",\n      \"updateDatetime\": 1670193360077,\n      \"userId\": \"aa072857-ef58-4703-97e1-4c1f455e2c0c\",\n      \"writeConnector\": {\n        \"connectorDestination\": \"KINESIS\",\n        \"kinesisShardCount\": 15,\n        \"kinesisStreamName\": \"tldwc60927c5ba114ca1b520a4950e9734b68\",\n        \"resourceLocation\": \"LetsData\"\n      }\n    },\n    {\n      \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/LetsData_AccessRole_IndexWebCrawlDataOct2022\",\n      \"computeEngine\": {\n        \"computeEngineType\": \"LAMBDA\",\n        \"concurrency\": 15,\n        \"memoryLimitInMegabytes\": 10240,\n        \"timeoutInSeconds\": 300\n      },\n      \"createDatetime\": 1670015188207,\n      \"customerAccountForAccess\": null,\n      \"datasetId\": \"1c74dc1b534ae72eb6fa50b4610ea1cf\",\n      \"datasetName\": \"IndexWebCrawlDataOct2022Subset2\",\n      \"region\": \"us-east-1\",\n      \"datasetProgress\": {\n        \"completedTasks\": 5,\n        \"errorTasks\": 0,\n        \"totalTasks\": 5\n      },\n      \"datasetStatus\": \"FROZEN\",\n      \"errorConnector\": {\n        \"bucketName\": \"tldec9eecbb2c573fc89a9a542debd6cba628\",\n        \"connectorDestination\": \"S3\",\n        \"resourceLocation\": \"LetsData\"\n      },\n      \"executionLogs\": [\n        {\n          \"endDatetime\": 1670015738199,\n          \"startDatetime\": 1670015445978\n        }\n      ],\n      \"manifestFile\": {\n        \"fileTypes\": [\n          \"WARC\",\n          \"WET\",\n          \"WAT\"\n        ],\n        \"manifestFileS3Uri\": \"s3://resonancemanifestfile/resonance_manifest_full_test.txt\",\n        \"manifestFileS3UriIsPublic\": false,\n        \"manifestType\": \"S3ReaderS3LinkManifestFile\",\n        \"readerType\": \"MULTIPLEFILESTATEMACHINEREADER\"\n      },\n      \"readConnector\": {\n        \"artifactFileS3Link\": \"s3://indexwebcrawl-jar/index-web-crawl-1.0-SNAPSHOT.jar\",\n        \"artifactFileS3LinkIsPublic\": false,\n        \"bucketName\": \"commoncrawl\",\n        \"connectorDestination\": \"S3\",\n        \"implementationLanguage\": \"JAVA\",\n        \"isBucketPublic\": true,\n        \"numberOfReaderFileTypes\": 3,\n        \"readerFileTypeImplementationClassNameMap\": {\n          \"WARC\": \"com.indexwebcrawl.parser.WARCFileParser\",\n          \"WAT\": \"com.indexwebcrawl.parser.WATFileParser\",\n          \"WET\": \"com.indexwebcrawl.parser.WETFileParser\"\n        },\n        \"readerFileTypeSet\": [\n          \"WARC\",\n          \"WET\",\n          \"WAT\"\n        ],\n        \"readerType\": \"MULTIPLEFILESTATEMACHINEREADER\"\n      },\n      \"tenantId\": \"e7148bad-2415-4a61-9189-7ad14ea5a212\",\n      \"updateDatetime\": 1670193344107,\n      \"userId\": \"aa072857-ef58-4703-97e1-4c1f455e2c0c\",\n      \"writeConnector\": {\n        \"connectorDestination\": \"KINESIS\",\n        \"kinesisShardCount\": 15,\n        \"kinesisStreamName\": \"tldwc9eecbb2c573fc89a9a542debd6cba628\",\n        \"resourceLocation\": \"LetsData\"\n      }\n    }\n  ],\n  \"next\": \"x3m2D9SduUj6ajaL9WTrxpOgRq7Zk3E/ncp0sAIWVlj67IujfcI2i85ynFCdzqVN0kGWL9Aziw5KzK5EfxsEffv9E2cbYvMzBDnN11/Wj9h3/0e69LcEapFeoC/enpSpemgn/vsPWE2/aBYoDrKgl+zguIF3cGmnqLT6DFzSjMaw9QkosIuF3lkEbBBwNosurzepNMQfwawjoF+izWHHrJA7ZK77S+SXZeMYvqntTHCgZOpBt52QDkT0aRmdhgdhrzR7S1aAtni5Ayn3TJbb1IsO+4DBhMFjyzMK5+qy1ZVqirwM/jBbEiaDwyCXpUv4tNcam1MHWPbCQuMksLgQUMFQtgyXFKqqRlZo9AXEHLnUVVt7mZ1fwkYvjoy2YyvZeHjrlN0aBO5PaXXEi7kb28d/ADy28Kpdyh/FPudobOg6J90a0hSIAoVTLqW2yB0iZEhfd+Z9XjXcmBZO6+vwGMmrmPjLcJUyVgZUS7MDAMWlqhD2QLGaVo/ttORqEAx0f5HccOMYo6B/1sr6qKxW77/J0jzzJZHki5hLsxdglHk=\"\n}\n\n

Examples:

Example 1: list all datasets for the logged in user - GET www.letsdata.io/api/dataset/list?tenantId=tenantId&userId=userId
Example 2: Logged in as a TenantAdmin, list all datasets that was created by another user (userId: 078260ed-3124-4de0-8eee-cc5b5025e7ad) in the organization - GET www.letsdata.io/api/dataset/list?tenantId=tenantId&userId=078260ed-3124-4de0-8eee-cc5b5025e7ad
Example 3: List datasets filtering by datasetName prefix 'IndexWebCrawlData' - GET www.letsdata.io/api/dataset/list?tenantId=tenantId&userId=userId&datasetNamePrefix=IndexWebCrawlData
Example 4: List datasets filtering by datasetStatus 'ERRORED' - GET www.letsdata.io/api/dataset/list?tenantId=tenantId&userId=userId&datasetStatus=ERRORED
Example 5: List datasets, paginate using the next token from prior call and limit the next page results by specifying limit - GET www.letsdata.io/api/dataset/list?tenantId=tenantId&userId=userId&limit=100&next= x3m2D9SduUj6ajaL9WTrxpOgRq7Zk3E...
Example 6: List datasets, paginate backwards using the pagination token and limit the results by specifying limit - GET www.letsdata.io/api/dataset/list?tenantId=tenantId&userId=userId&limit=100&forward=false&next x3m2D9SduUj6ajaL9WTrxpOgRq7Zk3E...
Example 7: # list datasets that are for 'IndexWebCrawlData' usecase, filtering by 'ERRORED' datasets, limiting the results to 100 datasets - GET www.letsdata.io/api/dataset/list?tenantId=tenantId&userId=userId&datasetNamePrefix=IndexWebCrawlData&datasetStatus=ERRORED&limit=100

Docs:

You can learn about Datasets at: https://www.letsdata.io/docs#datasets

\n","urlObject":{"path":["api","dataset","list"],"host":["https://www.letsdata.io"],"query":[{"disabled":true,"description":{"content":"

[Optional] Filter the results by returning datasets whose datasetName is equal to the CLI input datasetNamePrefix. For example, &datasetNamePrefix=IndexWebCrawlData to list datasets whose name starts with the prefix IndexWebCrawlData

\n","type":"text/plain"},"key":"datasetNamePrefix","value":""},{"disabled":true,"description":{"content":"

[Optional] Filter the results by returning results whose datasetStatus is equal to the the given datasetStatus, where the datasetStatus needs to be from the datasetStatus set: CREATED, INITIALIZING, PROCESSING, COMPLETED, ERRORED, DESCALED, FROZEN, DELETED, UPDATING, REDRIVING, STOPPING_ERROR, STOPPING_COMPLETE, DESCALING, FREEZING, DELETING. For example, &datasetStatus=DELETED to list deleted datasets.

\n","type":"text/plain"},"key":"datasetStatus","value":""},{"description":{"content":"

The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For example, &userId=078260ed-3124-4de0-8eee-cc5b5025e7ad to list datasets created by user 078260ed-3124-4de0-8eee-cc5b5025e7ad (user is a different user in the same Tenant / Organization)

\n","type":"text/plain"},"key":"userId","value":"userId"},{"disabled":true,"description":{"content":"

[Optional] The limit for the number of results that are to be returned by the command. This is used in conjunction with pagination when large number of records are being retrieved. This is optional and the system does set some meaningful defaults in most APIs. Also, this limit is a hint for the API and the results are not guaranteed to be exactly the same number as the limit. The user needs to handle the following cases when specifying limits (Rule of thumb in using limits is to treat it as a soft max limit): * The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved. * The records may be a little more than the limit (~<10 or so). User should handle these gracefully.

\n","type":"text/plain"},"key":"limit","value":""},{"disabled":true,"description":{"content":"

\n","type":"text/plain"},"key":"next","value":""},{"disabled":true,"description":{"content":"

[Optional] When the next token is specified for pagination, the same token can be used to retrieve the next page or the previous page by specifying this boolean parameter. &forward=true fetches the next page, &forward=false fetches the previous page. For example, &forward=false&next=x3m2D9SduUj6...

\n","type":"text/plain"},"key":"forward","value":""},{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"}],"variable":[]}},"response":[{"id":"75446c92-4caf-4d17-a65d-020e70d7eed0","name":"Example - List Datasets","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/dataset/list?userId=userId&tenantId=tenantId","host":["https://www.letsdata.io"],"path":["api","dataset","list"],"query":[{"key":"datasetNamePrefix","value":"","description":"[Optional] Filter the results by returning datasets whose datasetName is equal to the CLI input datasetNamePrefix. For example, &datasetNamePrefix=IndexWebCrawlData to list datasets whose name starts with the prefix IndexWebCrawlData\n","disabled":true},{"key":"datasetStatus","value":"","description":"[Optional] Filter the results by returning results whose datasetStatus is equal to the the given datasetStatus, where the datasetStatus needs to be from the datasetStatus set: CREATED, INITIALIZING, PROCESSING, COMPLETED, ERRORED, DESCALED, FROZEN, DELETED, UPDATING, REDRIVING, STOPPING_ERROR, STOPPING_COMPLETE, DESCALING, FREEZING, DELETING. For example, &datasetStatus=DELETED to list deleted datasets.","disabled":true},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For example, &userId=078260ed-3124-4de0-8eee-cc5b5025e7ad to list datasets created by user 078260ed-3124-4de0-8eee-cc5b5025e7ad (user is a different user in the same Tenant / Organization)"},{"key":"limit","value":"","description":"[Optional] The limit for the number of results that are to be returned by the command. This is used in conjunction with pagination when large number of records are being retrieved. This is optional and the system does set some meaningful defaults in most APIs. Also, this limit is a hint for the API and the results are not guaranteed to be exactly the same number as the limit. The user needs to handle the following cases when specifying limits (Rule of thumb in using limits is to treat it as a soft max limit): * The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved. * The records may be a little more than the limit (\\~<10 or so). User should handle these gracefully.","disabled":true},{"key":"next","value":"","description":"[Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved. For example, &next =x3m2D9SduUj6...","disabled":true},{"key":"forward","value":"","description":"[Optional] When the next token is specified for pagination, the same token can be used to retrieve the next page or the previous page by specifying this boolean parameter. &forward=true fetches the next page, &forward=false fetches the previous page. For example, &forward=false&next=x3m2D9SduUj6...","disabled":true},{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 16:37:15 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"13382"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"4bd156fd-7180-4a25-9b3a-b360c281b202"},{"key":"x-amz-apigw-id","value":"UbA0NEe8IAMEEvg="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ede1b4-3b24046d5cd7ac5a45d00b97"}],"cookie":[],"responseTime":null,"body":"{\n \"next\": null,\n \"datasets\": [\n {\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"customerAccessRoleArn\": \"arn:aws:iam::223413462631:role/TestCustomerAccess8e04743d71815b7867a915c5da514db6IAMRole\",\n \"readConnector\": {\n \"readerType\": \"KINESISSTREAMREADER\",\n \"streamArn\": \"arn:aws:kinesis:us-east-1:223413462631:stream/tldwc899306135a05a56dc93fc9a1e1c790e0\",\n \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n \"throwOnMessageReadFail\": false,\n \"connectorDestination\": \"KINESIS\",\n \"interfaceECRImageResourceLocation\": \"Customer\",\n \"artifactImplementationLanguage\": \"PYTHON\",\n \"streamResourceLocation\": \"LetsData\",\n \"region\": \"us-east-1\"\n },\n \"writeConnector\": {\n \"queueMaxReceiveCount\": 2147483647,\n \"connectorDestination\": \"SQS\",\n \"queueVisibilityTimeout\": 300,\n \"messageIdAttributeName\": \"docId\",\n \"queueRetentionInSecs\": 1209600,\n \"throwOnMessageSendFail\": false,\n \"resourceLocation\": \"LetsData\",\n \"queueName\": \"tldwc8e04743d71815b7867a915c5da514db6\",\n \"messageGroupIdAttributeName\": null,\n \"messageDeduplicationIdAttributeName\": null,\n \"region\": \"us-east-1\",\n \"queueEnableDeduplication\": false,\n \"queueAccountId\": \"223413462631\"\n },\n \"errorConnector\": {\n \"bucketName\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA\",\n \"memoryLimitInMegabytes\": 10240,\n \"concurrency\": 2,\n \"timeoutInSeconds\": 900\n },\n \"manifestFile\": {\n \"readerType\": \"KINESISSTREAMREADER\",\n \"readerTaskStartFromCondition\": \"Earliest\",\n \"readerTaskContinuousPollFrequency\": \"PollWithExponentialFrequencyMax1Min\",\n \"manifestType\": \"KinesisStreamReaderManifest\",\n \"readerTaskStopCondition\": \"Continuous\",\n \"region\": \"us-east-1\"\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"datasetStatus\": \"STOPPING_ERROR\",\n \"datasetProgress\": {\n \"totalTasks\": 1,\n \"completedTasks\": 0,\n \"errorTasks\": 0\n },\n \"executionLogs\": [\n {\n \"startDatetime\": 1702428455543,\n \"endDatetime\": null\n }\n ],\n \"createDatetime\": 1702428260509,\n \"updateDatetime\": 1707513923408\n },\n {\n \"datasetName\": \"CommonCrawlSparkDataset58\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"customerAccessRoleArn\": \"arn:aws:iam::223413462631:role/TestCustomerAccess27a144b37c661375a959cefb26a8aeb4IAMRole\",\n \"readConnector\": {\n \"readerType\": \"SPARKREADER\",\n \"sparkFileFormat\": \"text\",\n \"bucketName\": \"commoncrawl\",\n \"artifactFileS3Link\": \"s3://resonancecommoncrawl-jar/letsdata-common-crawl-1.0-SNAPSHOT-jar-with-dependencies.jar\",\n \"connectorDestination\": \"S3\",\n \"artifactImplementationLanguage\": \"JAVA\",\n \"artifactFileS3LinkResourceLocation\": \"Customer\",\n \"region\": \"us-east-1\",\n \"bucketResourceLocation\": \"Customer\",\n \"sparkReadOptions\": {\n \"lineSep\": \"\\n\\r\\n\\r\\n\"\n }\n },\n \"writeConnector\": {\n \"sparkFileFormat\": \"json\",\n \"bucketName\": \"tldwc27a144b37c661375a959cefb26a8aeb4\",\n \"sparkWriteOptions\": {\n \"compression\": \"gzip\"\n },\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\",\n \"writerType\": \"Spark\"\n },\n \"errorConnector\": {\n \"bucketName\": \"tldec27a144b37c661375a959cefb26a8aeb4\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"sparkReducerInterfaceClassName\": \"com.letsdata.commoncrawl.interfaces.implementations.spark.CommonCrawlSparkReducer\",\n \"sparkMapperInterfaceClassName\": \"com.letsdata.commoncrawl.interfaces.implementations.spark.CommonCrawlSparkMapper\",\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA_AND_SPARK\",\n \"runSparkInterfaces\": \"MAPPER_AND_REDUCER\",\n \"memoryLimitInMegabytes\": 10240,\n \"concurrency\": 5,\n \"timeoutInSeconds\": 900\n },\n \"manifestFile\": {\n \"readerType\": \"SPARKREADER\",\n \"manifestType\": \"S3ReaderTextManifestFile\",\n \"region\": \"us-east-1\",\n \"fileContents\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00000.warc.wet.gz\"\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"27a144b37c661375a959cefb26a8aeb4\",\n \"datasetStatus\": \"COMPLETED\",\n \"datasetProgress\": {\n \"totalTasks\": 1,\n \"completedTasks\": 1,\n \"errorTasks\": 0\n },\n \"executionLogs\": [\n {\n \"startDatetime\": 1707523425861,\n \"endDatetime\": 1707523528798\n }\n ],\n \"createDatetime\": 1707523036812,\n \"updateDatetime\": 1708819210631\n },\n {\n \"datasetName\": \"CommonCrawlSparkDataset60\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"customerAccessRoleArn\": \"arn:aws:iam::223413462631:role/TestCustomerAccessdc2685d35002614c77a1e0d9eb850727IAMRole\",\n \"readConnector\": {\n \"readerType\": \"SPARKREADER\",\n \"sparkFileFormat\": \"text\",\n \"bucketName\": \"commoncrawl\",\n \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n \"connectorDestination\": \"S3\",\n \"interfaceECRImageResourceLocation\": \"Customer\",\n \"artifactImplementationLanguage\": \"PYTHON\",\n \"region\": \"us-east-1\",\n \"bucketResourceLocation\": \"Customer\",\n \"sparkReadOptions\": {\n \"lineSep\": \"\\n\\r\\n\\r\\n\"\n }\n },\n \"writeConnector\": {\n \"sparkFileFormat\": \"json\",\n \"bucketName\": \"tldwcdc2685d35002614c77a1e0d9eb850727\",\n \"sparkWriteOptions\": {\n \"compression\": \"gzip\"\n },\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\",\n \"writerType\": \"Spark\"\n },\n \"errorConnector\": {\n \"bucketName\": \"tldecdc2685d35002614c77a1e0d9eb850727\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA_AND_SPARK\",\n \"runSparkInterfaces\": \"MAPPER_AND_REDUCER\",\n \"memoryLimitInMegabytes\": 10240,\n \"concurrency\": 5,\n \"timeoutInSeconds\": 900\n },\n \"manifestFile\": {\n \"readerType\": \"SPARKREADER\",\n \"manifestType\": \"S3ReaderTextManifestFile\",\n \"region\": \"us-east-1\",\n \"fileContents\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00000.warc.wet.gz\"\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"dc2685d35002614c77a1e0d9eb850727\",\n \"datasetStatus\": \"COMPLETED\",\n \"datasetProgress\": {\n \"totalTasks\": 1,\n \"completedTasks\": 1,\n \"errorTasks\": 0\n },\n \"executionLogs\": [\n {\n \"startDatetime\": 1707535904791,\n \"endDatetime\": 1707536105980\n }\n ],\n \"createDatetime\": 1707524494775,\n \"updateDatetime\": 1708909210414\n },\n {\n \"datasetName\": \"DDBReader1\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"customerAccessRoleArn\": \"arn:aws:iam::223413462631:role/TestCustomerAccess36d407c4235c453a04b1d8c4a2f1d9ccIAMRole\",\n \"readConnector\": {\n \"readerType\": \"DYNAMODBTABLEREADER\",\n \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n \"throwOnMessageReadFail\": false,\n \"connectorDestination\": \"DYNAMODB\",\n \"interfaceECRImageResourceLocation\": \"Customer\",\n \"artifactImplementationLanguage\": \"JAVASCRIPT\",\n \"region\": \"us-east-1\",\n \"tableName\": \"tldwcd4354980b12545d7d23a9f72b0f70b38\",\n \"tableResourceLocation\": \"LetsData\"\n },\n \"writeConnector\": {\n \"queueMaxReceiveCount\": 2147483647,\n \"connectorDestination\": \"SQS\",\n \"queueVisibilityTimeout\": 300,\n \"messageIdAttributeName\": \"docId\",\n \"queueRetentionInSecs\": 1209600,\n \"throwOnMessageSendFail\": false,\n \"resourceLocation\": \"LetsData\",\n \"queueName\": \"tldwc36d407c4235c453a04b1d8c4a2f1d9cc\",\n \"messageGroupIdAttributeName\": null,\n \"messageDeduplicationIdAttributeName\": null,\n \"region\": \"us-east-1\",\n \"queueEnableDeduplication\": false,\n \"queueAccountId\": \"223413462631\"\n },\n \"errorConnector\": {\n \"bucketName\": \"tldec36d407c4235c453a04b1d8c4a2f1d9cc\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA\",\n \"memoryLimitInMegabytes\": 10240,\n \"concurrency\": 5,\n \"timeoutInSeconds\": 900\n },\n \"manifestFile\": {\n \"readerType\": \"DYNAMODBTABLEREADER\",\n \"manifestType\": \"DynamoDBTableReaderManifest\",\n \"readerTaskStopCondition\": \"SingleTableScan\",\n \"region\": \"us-east-1\",\n \"numReaderTasks\": 4\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"36d407c4235c453a04b1d8c4a2f1d9cc\",\n \"datasetStatus\": \"STOPPING_COMPLETE\",\n \"datasetProgress\": {\n \"totalTasks\": 4,\n \"completedTasks\": 2,\n \"errorTasks\": 1\n },\n \"executionLogs\": [\n {\n \"startDatetime\": 1703049424727,\n \"endDatetime\": 1703050338992\n },\n {\n \"startDatetime\": 1703051060704,\n \"endDatetime\": 1703051114140\n },\n {\n \"startDatetime\": 1703051374306,\n \"endDatetime\": 1703051425770\n },\n {\n \"startDatetime\": 1703051556786,\n \"endDatetime\": null\n }\n ],\n \"createDatetime\": 1703048644180,\n \"updateDatetime\": 1707510217627\n },\n {\n \"datasetName\": \"DDBStreamReader3\",\n \"region\": \"us-west-2\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"customerAccessRoleArn\": \"arn:aws:iam::223413462631:role/TestCustomerAccessf056e862408df3c27ea3cc05212a79bdIAMRole\",\n \"readConnector\": {\n \"readerType\": \"DYNAMODBSTREAMREADER\",\n \"artifactFileS3Link\": \"s3://resonancecommoncrawl-jar/letsdata-common-crawl-1.0-SNAPSHOT-jar-with-dependencies.jar\",\n \"streamArn\": \"arn:aws:dynamodb:us-east-1:223413462631:table/tldwcd08b17aa13d968d2fb04a37c6d14f899/stream/2023-12-18T17:00:01.905\",\n \"throwOnMessageReadFail\": false,\n \"connectorDestination\": \"DYNAMODBSTREAMS\",\n \"artifactImplementationLanguage\": \"JAVA\",\n \"streamResourceLocation\": \"LetsData\",\n \"artifactFileS3LinkResourceLocation\": \"Customer\",\n \"region\": \"us-east-1\",\n \"streamReaderClassName\": \"com.letsdata.commoncrawl.interfaces.implementations.dynamodbstreams.CommonCrawlDDBStreamReader\"\n },\n \"writeConnector\": {\n \"connectorDestination\": \"KINESIS\",\n \"kinesisShardCount\": 1,\n \"kinesisStreamName\": \"tldwcf056e862408df3c27ea3cc05212a79bd\",\n \"region\": \"us-west-2\",\n \"resourceLocation\": \"LetsData\"\n },\n \"errorConnector\": {\n \"bucketName\": \"tldecf056e862408df3c27ea3cc05212a79bd\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-west-2\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA\",\n \"memoryLimitInMegabytes\": 5120,\n \"concurrency\": 5,\n \"timeoutInSeconds\": 900\n },\n \"manifestFile\": {\n \"readerType\": \"DYNAMODBSTREAMREADER\",\n \"readerTaskStartFromCondition\": \"Earliest\",\n \"readerTaskContinuousPollFrequency\": \"PollWithExponentialFrequencyMax1Min\",\n \"manifestType\": \"DynamoDBStreamReaderManifest\",\n \"readerTaskStopCondition\": \"Continuous\",\n \"region\": \"us-west-2\"\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"f056e862408df3c27ea3cc05212a79bd\",\n \"datasetStatus\": \"STOPPING_COMPLETE\",\n \"datasetProgress\": {\n \"totalTasks\": 8,\n \"completedTasks\": 5,\n \"errorTasks\": 0\n },\n \"executionLogs\": [\n {\n \"startDatetime\": 1702940770814,\n \"endDatetime\": null\n }\n ],\n \"createDatetime\": 1702940035490,\n \"updateDatetime\": 1707510339849\n },\n {\n \"datasetName\": \"S3RedShiftData\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"customerAccessRoleArn\": \"arn:aws:iam::223413462631:role/TestCustomerAccess6939c07aa4675e29bcae9eb8bc00d51fIAMRole\",\n \"readConnector\": {\n \"readerType\": \"SINGLEFILEREADER\",\n \"bucketName\": \"commoncrawl\",\n \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n \"connectorDestination\": \"S3\",\n \"interfaceECRImageResourceLocation\": \"Customer\",\n \"artifactImplementationLanguage\": \"PYTHON\",\n \"region\": \"us-east-1\",\n \"bucketResourceLocation\": \"Customer\"\n },\n \"writeConnector\": {\n \"bucketName\": \"tldwc6939c07aa4675e29bcae9eb8bc00d51f\",\n \"connectorDestination\": \"S3\",\n \"fileRecordsSeparator\": \"\\n\",\n \"aggregateFileSizeInMB\": 128,\n \"folderName\": \"files\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\",\n \"writerType\": \"S3AggregateFile\"\n },\n \"errorConnector\": {\n \"bucketName\": \"tldec6939c07aa4675e29bcae9eb8bc00d51f\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA\",\n \"memoryLimitInMegabytes\": 10240,\n \"concurrency\": 12,\n \"timeoutInSeconds\": 300\n },\n \"manifestFile\": {\n \"readerType\": \"SINGLEFILEREADER\",\n \"manifestType\": \"S3ReaderTextManifestFile\",\n \"region\": \"us-east-1\",\n \"fileContents\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00000.warc.wet.gz\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00001.warc.wet.gz\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00002.warc.wet.gz\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00003.warc.wet.gz\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00004.warc.wet.gz\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00005.warc.wet.gz\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00006.warc.wet.gz\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00007.warc.wet.gz\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00008.warc.wet.gz\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00009.warc.wet.gz\"\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"6939c07aa4675e29bcae9eb8bc00d51f\",\n \"datasetStatus\": \"ERRORED\",\n \"datasetProgress\": {\n \"totalTasks\": 10,\n \"completedTasks\": 6,\n \"errorTasks\": 4\n },\n \"executionLogs\": [\n {\n \"startDatetime\": 1703535563040,\n \"endDatetime\": 1703536177637\n }\n ],\n \"createDatetime\": 1703535396852,\n \"updateDatetime\": 1707513022444\n }\n ]\n}"},{"id":"e068a97e-db70-44bf-b531-ceae344aac4e","name":"Example - Filter by datasetNamePrefix - List Datasets","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/dataset/list?datasetNamePrefix=CommonCrawlSpark&userId=userId&tenantId=tenantId","host":["https://www.letsdata.io"],"path":["api","dataset","list"],"query":[{"key":"datasetNamePrefix","value":"CommonCrawlSpark","description":"[Optional] Filter the results by returning datasets whose datasetName is equal to the CLI input datasetNamePrefix. For example, &datasetNamePrefix=IndexWebCrawlData to list datasets whose name starts with the prefix IndexWebCrawlData\n"},{"key":"datasetStatus","value":"","description":"[Optional] Filter the results by returning results whose datasetStatus is equal to the the given datasetStatus, where the datasetStatus needs to be from the datasetStatus set: CREATED, INITIALIZING, PROCESSING, COMPLETED, ERRORED, DESCALED, FROZEN, DELETED, UPDATING, REDRIVING, STOPPING_ERROR, STOPPING_COMPLETE, DESCALING, FREEZING, DELETING. For example, &datasetStatus=DELETED to list deleted datasets.","disabled":true},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For example, &userId=078260ed-3124-4de0-8eee-cc5b5025e7ad to list datasets created by user 078260ed-3124-4de0-8eee-cc5b5025e7ad (user is a different user in the same Tenant / Organization)"},{"key":"limit","value":"","description":"[Optional] The limit for the number of results that are to be returned by the command. This is used in conjunction with pagination when large number of records are being retrieved. This is optional and the system does set some meaningful defaults in most APIs. Also, this limit is a hint for the API and the results are not guaranteed to be exactly the same number as the limit. The user needs to handle the following cases when specifying limits (Rule of thumb in using limits is to treat it as a soft max limit): * The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved. * The records may be a little more than the limit (\\~<10 or so). User should handle these gracefully.","disabled":true},{"key":"next","value":"","description":"[Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved. For example, &next =x3m2D9SduUj6...","disabled":true},{"key":"forward","value":"","description":"[Optional] When the next token is specified for pagination, the same token can be used to retrieve the next page or the previous page by specifying this boolean parameter. &forward=true fetches the next page, &forward=false fetches the previous page. For example, &forward=false&next=x3m2D9SduUj6...","disabled":true},{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 16:38:41 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"4105"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"cd4fd2e3-d61a-46ec-9f2f-e3167bea70a2"},{"key":"x-amz-apigw-id","value":"UbBCpEx3IAMEWYg="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ede210-7c3ad759156e0f982d92c3e3"}],"cookie":[],"responseTime":null,"body":"{\n \"next\": null,\n \"datasets\": [\n {\n \"datasetName\": \"CommonCrawlSparkDataset58\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"customerAccessRoleArn\": \"arn:aws:iam::223413462631:role/TestCustomerAccess27a144b37c661375a959cefb26a8aeb4IAMRole\",\n \"readConnector\": {\n \"readerType\": \"SPARKREADER\",\n \"sparkFileFormat\": \"text\",\n \"bucketName\": \"commoncrawl\",\n \"artifactFileS3Link\": \"s3://resonancecommoncrawl-jar/letsdata-common-crawl-1.0-SNAPSHOT-jar-with-dependencies.jar\",\n \"connectorDestination\": \"S3\",\n \"artifactImplementationLanguage\": \"JAVA\",\n \"artifactFileS3LinkResourceLocation\": \"Customer\",\n \"region\": \"us-east-1\",\n \"bucketResourceLocation\": \"Customer\",\n \"sparkReadOptions\": {\n \"lineSep\": \"\\n\\r\\n\\r\\n\"\n }\n },\n \"writeConnector\": {\n \"sparkFileFormat\": \"json\",\n \"bucketName\": \"tldwc27a144b37c661375a959cefb26a8aeb4\",\n \"sparkWriteOptions\": {\n \"compression\": \"gzip\"\n },\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\",\n \"writerType\": \"Spark\"\n },\n \"errorConnector\": {\n \"bucketName\": \"tldec27a144b37c661375a959cefb26a8aeb4\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"sparkReducerInterfaceClassName\": \"com.letsdata.commoncrawl.interfaces.implementations.spark.CommonCrawlSparkReducer\",\n \"sparkMapperInterfaceClassName\": \"com.letsdata.commoncrawl.interfaces.implementations.spark.CommonCrawlSparkMapper\",\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA_AND_SPARK\",\n \"runSparkInterfaces\": \"MAPPER_AND_REDUCER\",\n \"memoryLimitInMegabytes\": 10240,\n \"concurrency\": 5,\n \"timeoutInSeconds\": 900\n },\n \"manifestFile\": {\n \"readerType\": \"SPARKREADER\",\n \"manifestType\": \"S3ReaderTextManifestFile\",\n \"region\": \"us-east-1\",\n \"fileContents\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00000.warc.wet.gz\"\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"27a144b37c661375a959cefb26a8aeb4\",\n \"datasetStatus\": \"COMPLETED\",\n \"datasetProgress\": {\n \"totalTasks\": 1,\n \"completedTasks\": 1,\n \"errorTasks\": 0\n },\n \"executionLogs\": [\n {\n \"startDatetime\": 1707523425861,\n \"endDatetime\": 1707523528798\n }\n ],\n \"createDatetime\": 1707523036812,\n \"updateDatetime\": 1708819210631\n },\n {\n \"datasetName\": \"CommonCrawlSparkDataset60\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"customerAccessRoleArn\": \"arn:aws:iam::223413462631:role/TestCustomerAccessdc2685d35002614c77a1e0d9eb850727IAMRole\",\n \"readConnector\": {\n \"readerType\": \"SPARKREADER\",\n \"sparkFileFormat\": \"text\",\n \"bucketName\": \"commoncrawl\",\n \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n \"connectorDestination\": \"S3\",\n \"interfaceECRImageResourceLocation\": \"Customer\",\n \"artifactImplementationLanguage\": \"PYTHON\",\n \"region\": \"us-east-1\",\n \"bucketResourceLocation\": \"Customer\",\n \"sparkReadOptions\": {\n \"lineSep\": \"\\n\\r\\n\\r\\n\"\n }\n },\n \"writeConnector\": {\n \"sparkFileFormat\": \"json\",\n \"bucketName\": \"tldwcdc2685d35002614c77a1e0d9eb850727\",\n \"sparkWriteOptions\": {\n \"compression\": \"gzip\"\n },\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\",\n \"writerType\": \"Spark\"\n },\n \"errorConnector\": {\n \"bucketName\": \"tldecdc2685d35002614c77a1e0d9eb850727\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA_AND_SPARK\",\n \"runSparkInterfaces\": \"MAPPER_AND_REDUCER\",\n \"memoryLimitInMegabytes\": 10240,\n \"concurrency\": 5,\n \"timeoutInSeconds\": 900\n },\n \"manifestFile\": {\n \"readerType\": \"SPARKREADER\",\n \"manifestType\": \"S3ReaderTextManifestFile\",\n \"region\": \"us-east-1\",\n \"fileContents\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00000.warc.wet.gz\"\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"dc2685d35002614c77a1e0d9eb850727\",\n \"datasetStatus\": \"COMPLETED\",\n \"datasetProgress\": {\n \"totalTasks\": 1,\n \"completedTasks\": 1,\n \"errorTasks\": 0\n },\n \"executionLogs\": [\n {\n \"startDatetime\": 1707535904791,\n \"endDatetime\": 1707536105980\n }\n ],\n \"createDatetime\": 1707524494775,\n \"updateDatetime\": 1708909210414\n }\n ]\n}"},{"id":"e158df03-45e2-4527-ad52-79dae7fb8dc9","name":"Example - Filter by datasetStatus - List Datasets","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/dataset/list?datasetStatus=COMPLETED&userId=userId&tenantId=tenantId","host":["https://www.letsdata.io"],"path":["api","dataset","list"],"query":[{"key":"datasetNamePrefix","value":"","description":"[Optional] Filter the results by returning datasets whose datasetName is equal to the CLI input datasetNamePrefix. For example, &datasetNamePrefix=IndexWebCrawlData to list datasets whose name starts with the prefix IndexWebCrawlData\n","disabled":true},{"key":"datasetStatus","value":"COMPLETED","description":"[Optional] Filter the results by returning results whose datasetStatus is equal to the the given datasetStatus, where the datasetStatus needs to be from the datasetStatus set: CREATED, INITIALIZING, PROCESSING, COMPLETED, ERRORED, DESCALED, FROZEN, DELETED, UPDATING, REDRIVING, STOPPING_ERROR, STOPPING_COMPLETE, DESCALING, FREEZING, DELETING. For example, &datasetStatus=DELETED to list deleted datasets."},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For example, &userId=078260ed-3124-4de0-8eee-cc5b5025e7ad to list datasets created by user 078260ed-3124-4de0-8eee-cc5b5025e7ad (user is a different user in the same Tenant / Organization)"},{"key":"limit","value":"","description":"[Optional] The limit for the number of results that are to be returned by the command. This is used in conjunction with pagination when large number of records are being retrieved. This is optional and the system does set some meaningful defaults in most APIs. Also, this limit is a hint for the API and the results are not guaranteed to be exactly the same number as the limit. The user needs to handle the following cases when specifying limits (Rule of thumb in using limits is to treat it as a soft max limit): * The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved. * The records may be a little more than the limit (\\~<10 or so). User should handle these gracefully.","disabled":true},{"key":"next","value":"","description":"[Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved. For example, &next =x3m2D9SduUj6...","disabled":true},{"key":"forward","value":"","description":"[Optional] When the next token is specified for pagination, the same token can be used to retrieve the next page or the previous page by specifying this boolean parameter. &forward=true fetches the next page, &forward=false fetches the previous page. For example, &forward=false&next=x3m2D9SduUj6...","disabled":true},{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 16:39:57 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"4105"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"53f3fdcf-bfeb-4553-9b49-5c3d2beb42f6"},{"key":"x-amz-apigw-id","value":"UbBOiG4coAMElOw="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ede25c-5ecaf83c5070eb8a63653d82"}],"cookie":[],"responseTime":null,"body":"{\n \"next\": null,\n \"datasets\": [\n {\n \"datasetName\": \"CommonCrawlSparkDataset58\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"customerAccessRoleArn\": \"arn:aws:iam::223413462631:role/TestCustomerAccess27a144b37c661375a959cefb26a8aeb4IAMRole\",\n \"readConnector\": {\n \"readerType\": \"SPARKREADER\",\n \"sparkFileFormat\": \"text\",\n \"bucketName\": \"commoncrawl\",\n \"artifactFileS3Link\": \"s3://resonancecommoncrawl-jar/letsdata-common-crawl-1.0-SNAPSHOT-jar-with-dependencies.jar\",\n \"connectorDestination\": \"S3\",\n \"artifactImplementationLanguage\": \"JAVA\",\n \"artifactFileS3LinkResourceLocation\": \"Customer\",\n \"region\": \"us-east-1\",\n \"bucketResourceLocation\": \"Customer\",\n \"sparkReadOptions\": {\n \"lineSep\": \"\\n\\r\\n\\r\\n\"\n }\n },\n \"writeConnector\": {\n \"sparkFileFormat\": \"json\",\n \"bucketName\": \"tldwc27a144b37c661375a959cefb26a8aeb4\",\n \"sparkWriteOptions\": {\n \"compression\": \"gzip\"\n },\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\",\n \"writerType\": \"Spark\"\n },\n \"errorConnector\": {\n \"bucketName\": \"tldec27a144b37c661375a959cefb26a8aeb4\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"sparkReducerInterfaceClassName\": \"com.letsdata.commoncrawl.interfaces.implementations.spark.CommonCrawlSparkReducer\",\n \"sparkMapperInterfaceClassName\": \"com.letsdata.commoncrawl.interfaces.implementations.spark.CommonCrawlSparkMapper\",\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA_AND_SPARK\",\n \"runSparkInterfaces\": \"MAPPER_AND_REDUCER\",\n \"memoryLimitInMegabytes\": 10240,\n \"concurrency\": 5,\n \"timeoutInSeconds\": 900\n },\n \"manifestFile\": {\n \"readerType\": \"SPARKREADER\",\n \"manifestType\": \"S3ReaderTextManifestFile\",\n \"region\": \"us-east-1\",\n \"fileContents\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00000.warc.wet.gz\"\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"27a144b37c661375a959cefb26a8aeb4\",\n \"datasetStatus\": \"COMPLETED\",\n \"datasetProgress\": {\n \"totalTasks\": 1,\n \"completedTasks\": 1,\n \"errorTasks\": 0\n },\n \"executionLogs\": [\n {\n \"startDatetime\": 1707523425861,\n \"endDatetime\": 1707523528798\n }\n ],\n \"createDatetime\": 1707523036812,\n \"updateDatetime\": 1708819210631\n },\n {\n \"datasetName\": \"CommonCrawlSparkDataset60\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"customerAccessRoleArn\": \"arn:aws:iam::223413462631:role/TestCustomerAccessdc2685d35002614c77a1e0d9eb850727IAMRole\",\n \"readConnector\": {\n \"readerType\": \"SPARKREADER\",\n \"sparkFileFormat\": \"text\",\n \"bucketName\": \"commoncrawl\",\n \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n \"connectorDestination\": \"S3\",\n \"interfaceECRImageResourceLocation\": \"Customer\",\n \"artifactImplementationLanguage\": \"PYTHON\",\n \"region\": \"us-east-1\",\n \"bucketResourceLocation\": \"Customer\",\n \"sparkReadOptions\": {\n \"lineSep\": \"\\n\\r\\n\\r\\n\"\n }\n },\n \"writeConnector\": {\n \"sparkFileFormat\": \"json\",\n \"bucketName\": \"tldwcdc2685d35002614c77a1e0d9eb850727\",\n \"sparkWriteOptions\": {\n \"compression\": \"gzip\"\n },\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\",\n \"writerType\": \"Spark\"\n },\n \"errorConnector\": {\n \"bucketName\": \"tldecdc2685d35002614c77a1e0d9eb850727\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA_AND_SPARK\",\n \"runSparkInterfaces\": \"MAPPER_AND_REDUCER\",\n \"memoryLimitInMegabytes\": 10240,\n \"concurrency\": 5,\n \"timeoutInSeconds\": 900\n },\n \"manifestFile\": {\n \"readerType\": \"SPARKREADER\",\n \"manifestType\": \"S3ReaderTextManifestFile\",\n \"region\": \"us-east-1\",\n \"fileContents\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00000.warc.wet.gz\"\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"dc2685d35002614c77a1e0d9eb850727\",\n \"datasetStatus\": \"COMPLETED\",\n \"datasetProgress\": {\n \"totalTasks\": 1,\n \"completedTasks\": 1,\n \"errorTasks\": 0\n },\n \"executionLogs\": [\n {\n \"startDatetime\": 1707535904791,\n \"endDatetime\": 1707536105980\n }\n ],\n \"createDatetime\": 1707524494775,\n \"updateDatetime\": 1708909210414\n }\n ]\n}"}],"_postman_id":"ca726b6c-8789-4ef4-b316-0376de967185"}],"id":"adbf9d36-fbcd-4b64-871e-7c1494616552","description":"

The list sub resource for the dataset resource, used to list datasets

\n","_postman_id":"adbf9d36-fbcd-4b64-871e-7c1494616552"},{"name":"create","item":[{"name":"Create Dataset","id":"2fcc920c-dab7-41ae-9902-fb711f5e19ba","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"body":{"mode":"raw","raw":"{\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"TargetUriExtractorDataset\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"readConnector\": {\n \"artifactImplementationLanguage\": \"Java\", \n \"artifactFileS3LinkResourceLocation\": \"Customer\",\n \"artifactFileS3Link\": \"s3://resonancecommoncrawl-jar/letsdata-common-crawl-1.0-SNAPSHOT-jar-with-dependencies.jar\", \n \"connectorDestination\": \"S3\",\n \"readerType\": \"Single File Reader\",\n \"bucketName\": \"commoncrawl\",\n \"bucketResourceLocation\": \"Customer\",\n \"singleFileParserImplementationClassName\": \"com.letsdata.example.TargetUriExtractor\"\n },\n \"writeConnector\": {\n \"connectorDestination\": \"Kinesis\",\n \"resourceLocation\": \"letsdata\",\n \"kinesisShardCount\": 15\n },\n \"errorConnector\": {\n \"connectorDestination\": \"S3\",\n \"resourceLocation\": \"letsdata\"\n },\n \"computeEngine\": {\n \"computeEngineType\": \"Lambda\",\n \"concurrency\": 15\n },\n \"manifestFile\": {\n \"fileContents\": \"crawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00000.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00001.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00002.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00003.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00004.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00005.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00006.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00007.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00008.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00009.warc.gz\",\n \"manifestType\": \"S3ReaderTextManifestFile\", \n \"readerType\": \"SINGLEFILEREADER\"\n }\n}\n","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/dataset/create","description":"

dataset/create

The datasets/create POST api creates a new dataset on #Let's Data for processing using the dataset configuration json.

Here is an example dataset configuration json that can be used to create a dataset by sending it as the data for the POST request at api/dataset/create endpoint.

Example dataset configuration

{\n    \"tenantId\": \"tenantId\",\n    \"userId\": \"userId\",\n    \"datasetName\": \"TargetUriExtractorDataset\",\n    \"region\": \"us-east-1\",\n    \"accessGrantRoleArn\": \"arn:aws:iam::308240606591:role/LetsData_AccessRole_TargetUriExtractor\",\n    \"customerAccountForAccess\": \"308240606591\",\n    \"readConnector\": {\n          \"artifactImplementationLanguage\": \"Java\",\n          \"artifactFileS3LinkResourceLocation\": \"Customer\",\n          \"artifactFileS3Link\": \"s3://targeturiextractorjar/target-uri-extractor-1.0-SNAPSHOT-jar-with-dependencies.jar\",\n          \"connectorDestination\": \"S3\",\n          \"readerType\": \"Single File Reader\",\n          \"bucketName\": \"commoncrawl\",\n          \"bucketResourceLocation\": \"LetsData\",\n          \"singleFileParserImplementationClassName\": \"com.letsdata.example.TargetUriExtractor\"\n    },\n    \"writeConnector\": {\n          \"connectorDestination\": \"Kinesis\",\n          \"resourceLocation\": \"letsdata\",\n          \"kinesisShardCount\": 15\n    },\n    \"errorConnector\": {\n          \"connectorDestination\": \"S3\",\n          \"resourceLocation\": \"letsdata\"\n    },\n    \"computeEngine\": {\n        \"computeEngineType\": \"Lambda\",\n        \"concurrency\": 15\n    },\n    \"manifestFile\": {\n        \"fileContents\": \"crawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00000.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00001.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00002.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00003.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00004.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00005.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00006.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00007.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00008.warc.gz\\ncrawl-data/CC-MAIN-2022-21/segments/1652662509990.19/warc/CC-MAIN-20220516041337-20220516071337-00009.warc.gz\",\n        \"manifestType\": \"S3ReaderTextManifestFile\",\n        \"readerType\": \"SINGLEFILEREADER\"\n   }\n}\n\n

Input Parameters:

The configuration details are different for different usecases, for example, a dataset that reads data from S3 has different configuration from a dataset that reads data from Kinesis.Here is a high level schema:

    {\n        \"tenantId\": \"String\",\n        \"userId\": \"String\",\n        \"datasetName\": \"String\",\n        \"region\": \"String\",\n        \"accessGrantRoleArn\": \"String\",\n        \"customerAccountForAccess\": \"String\",\n        \"readConnector\": {\n            ...\n        },\n        \"writeConnector\": {\n            ...\n        },\n        \"errorConnector\": {\n            ...\n        },\n        \"computeEngine\": {\n            ...\n        },\n        \"manifestFile\": {\n            ...\n        }\n    }\n\n

The schema above has the following configuration sections (datasetName, accessGrantRoleArn, customerAccountForAccess, readConnector, writeConnector, errorConnector, computeEngine, manifestFile) that need to be specified. Lets look at these individually:

tenantId: The tenantId of the logged in user
userId: The userId of the logged in user
datasetName: You need to specify a unique name for the dataset. This is alphanumeric and cannot have any special characters (- _ . : | etc. are disallowed)
region: The AWS region for the dataset. LetsData supported AWS regions: [us-east-1, us-east-2, us-west-2, eu-west-1, ap-south-1, ap-northeast-1]
accessGrantRoleArn: You need to specify an AWS IAM role that has access to the resources external to #Let's Data that would be used in the dataset. For example, if the read connector S3 bucket is not public, you'll need to add access for the #Let's Data AWS account. See the Access Grants docs for details around these: https://www.letsdata.io/docs/access-grants
customerAccountForAccess: If #Let's Data is creating any resources automatically in the dataset, then to access these resources, we need to grant your AWS account access. We'll be granting this AWS account access to these #Let's Data managed resources. (For example, these could be the error file S3 buckets or the write connector kinesis stream)

Read Connector

This is the read connector configuration. The read connector configuration can be different for different read destinations - for example, reading from S3 requires different configuration than reading from SQS. The different read connectors have the following common configuration elements which are in the schema across all read connectors.

region: (Optional) The optional read connector region and is set to dataset's region if unspecified. The read connector region tells LetsData a couple of things - 1./ what region is the read destination (S3 Bucket, SQS queue) located in 2./ the region that the user data handler artifact jar is located in. LetsData will create clients for this region to connect to these buckets / queues etc. Supported Regions: [us-east-1, us-east-2, us-west-2, eu-west-1, ap-south-1, ap-northeast-1]. As of now, we require the artifact and the read connector to be in the same region - this is purely beacause we havent separated this configuration yet. Ideally, artifact should have its own region and read connector its own separate region. However, this is a minor issue that we will fix in our upcoming releases
connectorDestination: The data destination for the connector. This can be S3, SQS or any of the supported read connector destinations.
artifactImplementationLanguage: The read connector implementation of the #Let's Data interface is called the artifact and is implemented in either Java, Python or Javascript. When the implementation is in Java, the artifact is essentially a JAR file with the implementation of the #Let's Data data interface. For Python and Javascript, the artifact is an ECR Image with the #LetsData interface implementation.
JAR File
- artifactFileS3Link: The S3 link of the artifact - the JAR file that implements the required interfaces mentioned above.
- artifactFileS3LinkResourceLocation: #Let's Data needs to know how to access the artifactFileS3Link. If it is in the customer account, we'll use the IAM Role specified in the dataset's accessGrantRoleArn to access this JAR file. Otherwise, we'll use #Let's Data account to access. You'll need to add access to this JAR file in the IAM role's policy document.
\n
ECR Image
- interfaceECRImagePath: The ECR image path of the artifact that implements the #LetsData interfaces in either python or javascript. For example, 151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_javascript_functions:latest
- interfaceECRImageResourceLocation: #Let's Data needs to know how to access the ECR image at the interfaceECRImagePath. If it is in the customer account (interfaceECRImageResourceLocation: Customer), we'll use the LetsData Lambda function IAM Role to access he ECR Image. You'll need to add arn:aws:lambda:us-east-1:956943252347:function:* to the ECR Repo access. Otherwise (interfaceECRImageResourceLocation: LetsData), we'll use #Let's Data account to access. See Access Grants Docs for details.
\n

You can find the different supported reader type use cases, the configuration schema and examples in the read connector docs.

Supported Read Connectors

Manifest File

The manifest file defines the amount of work for a dataset - how the read data source and the reader type is mapped to #Let's Data tasks and any additional details around the read destination's execution environment.\nEvery read connector destination has a different manifest file configuration schema. The different supported manifest files are described in detail at the manifest file docs:

Supported Manifest Files

Write Connector

This is the write connector configuration. The write connector configuration can be different for different write destinations - for example, writing to S3 requires different configuration than writing to Kinesis. However, the following writeConnector configuration is common to all writeConnector implementations:\n (docs: https://www.letsdata.io/docs#writeconnectors)

region: (Optional) The optional write connector region and is set to dataset's region if unspecified. The write connector region is where the write destination (queue, table, stream, index, bucket, cluster etc) is located. When the dataset starts writing, it will create clients for the write connector region to connect to these write destinations. Specify an incorrect region and LetsData won't be able to connect. Supported Regions: [us-east-1, us-east-2, us-west-2, eu-west-1, ap-south-1, ap-northeast-1]
connectorDestination: The data destination for the connector. This can be S3, SQS or any of the supported write connector destinations.
resourceLocation: In terms of access, the different resources that are written to can be divided into two groups:\"
- Customer: Resources that are located in external accounts. Resources that are not located in #Let's Data but are used in the write connector can either be public or access limited by the owner. In these cases, #Let's Data requires that the owner adds #Let's Data to the access lists. Docs: https://www.letsdata.io/docs#accessgrants\"
- LetsData: Resources that located in #Let's Data account. Resources that are located in #Let's Data are managed completely by #Let's Data - we'll grant the customer account access to these resources to read, write and manage them.
\n

Set this to 'letsdata' if you'd like #Let'sData to create the write destination resource (kinesis stream, dynamo db table etc) and grant the customer account access. Set this to 'customer' if #Let's Data should write errors to an existing kinesis stream (we'll use the IAM Role specified in the dataset's accessGrantRoleArn to access the write destination).

There are some specific configuration elements for each write connector destination. You can find he different supported writer type use cases, the configuration schema and examples in the write connector docs.

Supported Write Connectors

Error Connector

This is the error connector configuration. The error connector configuration can be different for different error destinations - for example, writing errors to S3 requires different configuration than writing errors to Kinesis. You can find he different supported error connector configurations at the error connector docs.

Supported Error Connectors

S3 Error Connector

Compute Engine

This is the compute engine configuration. The compute engine configuration can be different for different compute engines - for example, compute engine AWS Lambda has different configuration than AWS Sagemaker and Lambda as the compute engine. You can find he different supported compute engine configurations at the compute engine docs.

Supported Compute Engines

Lambda
Sagemaker
Spark

Example Dataset Configurations:

Example configuration that does SQS read, lambda compute engine, kinesis writes and errors to S3

{\n  \"datasetName\": \"TargetUriExtractorSQSReadKinesisWrite1\",\n  \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n  \"customerAccountForAccess\": \"151166716410\",\n  \"region\": \"us-east-1\",\n  \"readConnector\": {\n    \"artifactImplementationLanguage\": \"python\",\n    \"interfaceECRImageResourceLocation\": \"Customer\",\n    \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n    \"connectorDestination\": \"SQS\",\n    \"queueName\": \"tldwc11ac234d716866c2f9cf763107e2a308\",\n    \"resourceLocation\": \"LetsData\"\n  },\n  \"writeConnector\": {\n    \"connectorDestination\": \"Kinesis\",\n    \"resourceLocation\": \"letsdata\",\n    \"kinesisShardCount\": 1\n  },\n  \"errorConnector\": {\n    \"connectorDestination\": \"S3\",\n    \"resourceLocation\": \"letsdata\"\n  },\n  \"computeEngine\": {\n    \"computeEngineType\": \"Lambda\",\n    \"concurrency\": 2,\n    \"timeoutInSeconds\": 900\n  },\n  \"manifestFile\": {\n    \"sqsReaderTaskStopCondition\": \"DrainQueues\",\n    \"sqsReaderTaskStopAfterConsecutiveEmptyReceives\": 10\n  }\n}\n

Example configuration that does DynamoDBStreams read, lambda compute engine, writes to SQS and errors to S3

{\n  \"datasetName\": \"DDBStreamReader\",\n  \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n  \"customerAccountForAccess\": \"151166716410\",\n  \"region\": \"us-east-1\",\n  \"readConnector\": {\n    \"connectorDestination\": \"DYNAMODBSTREAMS\",\n    \"artifactImplementationLanguage\": \"Python\",\n    \"interfaceECRImageResourceLocation\": \"Customer\",\n    \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n    \"streamArn\": \"arn:aws:dynamodb:us-east-1:223413462631:table/tldwcd08b17aa13d968d2fb04a37c6d14f899/stream/2023-12-18T17:00:01.905\",\n    \"resourceLocation\": \"LetsData\"\n  },\n  \"writeConnector\": {\n    \"connectorDestination\": \"SQS\",\n    \"resourceLocation\": \"letsdata\",\n    \"messageIdAttributeName\": \"docId\"\n  },\n  \"errorConnector\": {\n    \"connectorDestination\": \"S3\",\n    \"resourceLocation\": \"letsdata\"\n  },\n  \"computeEngine\": {\n    \"computeEngineType\": \"LAMBDA\",\n    \"concurrency\": 2,\n    \"memoryLimitInMegabytes\": 10240,\n    \"timeoutInSeconds\": 900,\n    \"logLevel\": \"WARN\"\n  },\n  \"manifestFile\": {\n    \"dynamoDBReaderTaskStopCondition\": \"Continuous\",\n    \"dynamoDBReaderTaskStartFromCondition\": \"Earliest\",\n    \"dynamoDBReaderTaskContinuousPollFrequency\": \"Poll with exponential frequency (max 1 min)\",\n    \"manifestType\": \"DynamoDBStreamReaderManifest\"\n  }\n}\n

Example configuration that does Kinesis Read, Sagemaker inferences, SQS writes and S3 Errors in Python

{\n  \"tenantId\": \"tenantId\",\n  \"userId\": \"userId\",\n  \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython1\",\n  \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n  \"customerAccountForAccess\": \"151166716410\",\n  \"region\": \"us-east-1\",\n  \"readConnector\": {\n    \"connectorDestination\": \"KINESIS\",\n    \"artifactImplementationLanguage\": \"Python\",\n    \"interfaceECRImageResourceLocation\": \"Customer\",\n    \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n    \"readerType\": \"KINESISSTREAMREADER\",\n    \"streamArn\": \"arn:aws:kinesis:us-east-1:223413462631:stream/tldwce4a4bf865161b4d49f3b26690c7e6c32\",\n    \"resourceLocation\": \"LetsData\"\n  },\n  \"writeConnector\": {\n    \"connectorDestination\": \"SQS\",\n    \"resourceLocation\": \"letsdata\",\n    \"messageIdAttributeName\": \"docId\"\n  },\n  \"errorConnector\": {\n    \"connectorDestination\": \"S3\",\n    \"resourceLocation\": \"letsdata\"\n  },\n  \"computeEngine\": {\n    \"computeEngineType\": \"LAMBDA_AND_SAGEMAKER\",\n    \"lambda\": {\n      \"lambdaConcurrency\": 2,\n      \"lambdaMemoryLimitInMegabytes\": 10240,\n      \"lambdaTimeoutInSeconds\": 900,\n      \"logLevel\": \"WARN\"\n    },\n    \"model\": {\n      \"modelResourceLocation\": \"LetsData\",\n      \"modelUrl\": \"s3://resonancecommoncrawl-jar/model.tar.gz\",\n      \"modelUrlResourceLocation\": \"Customer\",\n      \"modelEnvironmentVariables\": {\n        \"HF_TASK\": \"question-answering\",\n        \"SAGEMAKER_PROGRAM\": \"inference.py\",\n        \"SAGEMAKER_SUBMIT_DIRECTORY\": \"model/\"\n      },\n      \"modelContainerImageName\": \"HuggingFace_Inference_4_12_3\"\n    },\n    \"endpoint\": {\n      \"sagemakerEndpointType\": \"Serverless\",\n      \"sagemakerEndpointResourceLocation\": \"LetsData\",\n      \"sagemakerServerless\": {\n        \"sagemakerEndpointConcurrency\": 15,\n        \"sagemakerMemoryLimitInMegabytes\": 6144\n      }\n    }\n  },\n  \"manifestFile\": {\n    \"kinesisReaderTaskStopCondition\": \"Continuous\",\n    \"kinesisReaderTaskStartFromCondition\": \"Earliest\",\n    \"kinesisReaderTaskContinuousPollFrequency\": \"Poll with exponential frequency (max 1 min)\",\n    \"manifestType\": \"KinesisStreamReaderManifest\"\n  }\n}\n

Output Parameters:

The output is a JSON map that has the following sections:

     {\n       \"statusCode\": \"SUCCESS|ERROR_FORM_DATA_VALIDATION|ERROR_ACCESS_VALIDATION\",\n       \"datasetId\": \"String - the datasetId\",\n       \"formValidationErrors\": [\n         \"form validation error messages\",\n         ...\n       ]\n       \"accessValidation\": {\n           \"Connector.API\": \"SUCCESS|<ErrorMsg>\",\n           ...\n       },\n       \"dataset\": {\n         ... 'The created dataset JSON'\n       }\n     }\n\n

Example: FORM VALIDATION ERROR response

     {\n       \"statusCode\": \"ERROR_FORM_DATA_VALIDATION\",\n       \"formValidationErrors\": [\n         \"A dataset with datasetName: CommonCrawlReworked97, tenantId: d5feaf90-71a9-41ee-b1b9-35e4242c3155, and userId: accb3567-2b6e-41ae-b00d-6ce1f9a58d94 already exists\"\n       ]\n     }\n\n

Example: ACCESS VALIDATION ERROR response

     {\n       \"statusCode\": \"ERROR_ACCESS_VALIDATION\",\n       \"accessValidation\": {\n         \"S3ReadConnector.ArtifactFileS3JarLink.GetObject\": \"SUCCESS\",\n         \"KinesisWriteConnector.UpdateShardCount\": \"SUCCESS\",\n         \"S3ReadConnector.S3ManifestFileLink.GetObject\": \"Bucket Does Not Exist - bucketName: resonancemanifestfile1\",\n         \"S3ReadConnector.ListBucket\": \"ListBucket succeeded but the manifest file\\u0027s object keys were not validated because of manifest file errors. This will be validated again when the manifest file errors are fixed - S3 Read Connector BucketName: resonancecommoncrawl\",\n         \"S3ReadConnector.GetObject\": \"Read manifest file\\u0027s object keys was skipped because of list bucket errors. These will be validated again when the list bucket file errors are fixed\",\n         \"KinesisWriteConnector.DescribeStream\": \"SUCCESS\",\n         \"S3ReadConnector.ArtifactFileS3Jar.ValidateClassNames\": \"SUCCESS\",\n         \"S3ErrorConnector.PutObject\": \"SUCCESS\",\n         \"S3ErrorConnector.ListBucket\": \"SUCCESS\",\n         \"S3ReadConnector.ManifestObjectsValidation\": \"SUCCESS\",\n         \"S3ErrorConnector.GetObject\": \"SUCCESS\",\n         \"KinesisWriteConnector.PutRecords\": \"SUCCESS\",\n         \"S3ErrorConnector.PutObjectTagging\": \"SUCCESS\",\n         \"S3ErrorConnector.GetObjectTagging\": \"SUCCESS\"\n       }\n     }\n\n

Example: SUCCESS response

{\n       \"statusCode\": \"SUCCESS\",\n       \"datasetId\": \"3e4fb6efdd494702a6e96f7a844ca4a6\",\n       \"accessValidation\": {\n         \"S3ReadConnector.ArtifactFileS3JarLink.GetObject\": \"SUCCESS\",\n         \"KinesisWriteConnector.UpdateShardCount\": \"SUCCESS\",\n         \"S3ReadConnector.S3ManifestFileLink.GetObject\": \"SUCCESS\",\n         \"S3ReadConnector.ListBucket\": \"SUCCESS\",\n         \"S3ReadConnector.GetObject\": \"SUCCESS\",\n         \"KinesisWriteConnector.DescribeStream\": \"SUCCESS\",\n         \"S3ReadConnector.ArtifactFileS3Jar.ValidateClassNames\": \"SUCCESS\",\n         \"S3ErrorConnector.PutObject\": \"SUCCESS\",\n         \"S3ErrorConnector.ListBucket\": \"SUCCESS\",\n         \"S3ReadConnector.ManifestObjectsValidation\": \"SUCCESS\",\n         \"S3ErrorConnector.GetObject\": \"SUCCESS\",\n         \"KinesisWriteConnector.PutRecords\": \"SUCCESS\",\n         \"S3ErrorConnector.PutObjectTagging\": \"SUCCESS\",\n         \"S3ErrorConnector.GetObjectTagging\": \"SUCCESS\"\n       },\n       \"dataset\": {\n         \"datasetName\": \"CommonCrawlReworked98\",\n         \"region\": \"us-east-1\",\n         \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n         \"customerAccountForAccess\": \"151166716410\",\n         \"readConnector\": {\n           \"readerType\": \"MULTIPLEFILESTATEMACHINEREADER\",\n           \"bucketName\": \"resonancecommoncrawl\",\n           \"artifactFileS3Link\": \"s3://resonancecommoncrawl-jar/letsdata-common-crawl-1.0-SNAPSHOT-jar-with-dependencies.jar\",\n           \"connectorDestination\": \"S3\",\n           \"multipleFileStateMachineReaderClassName\": \"com.letsdata.commoncrawl.interfaces.implementations.reader.CommonCrawlReader\",\n           \"readerFileTypeImplementationClassNameMap\": {\n             \"WARC\": \"com.letsdata.commoncrawl.interfaces.implementations.parser.WARCFileParser\",\n             \"WAT\": \"com.letsdata.commoncrawl.interfaces.implementations.parser.WATFileParser\",\n             \"WET\": \"com.letsdata.commoncrawl.interfaces.implementations.parser.WETFileParser\"\n           },\n           \"artifactImplementationLanguage\": \"JAVA\",\n           \"artifactFileS3LinkResourceLocation\": \"Customer\",\n           \"bucketResourceLocation\": \"Customer\"\n         },\n         \"writeConnector\": {\n           \"connectorDestination\": \"KINESIS\",\n           \"kinesisShardCount\": 15,\n           \"kinesisStreamName\": \"tldwc3e4fb6efdd494702a6e96f7a844ca4a6\",\n           \"resourceLocation\": \"LetsData\"\n         },\n         \"errorConnector\": {\n           \"bucketName\": \"tldec3e4fb6efdd494702a6e96f7a844ca4a6\",\n           \"connectorDestination\": \"S3\",\n           \"resourceLocation\": \"LetsData\"\n         },\n         \"computeEngine\": {\n           \"logLevel\": \"WARN\",\n           \"computeEngineType\": \"LAMBDA\",\n           \"memoryLimitInMegabytes\": 5120,\n           \"concurrency\": 15,\n           \"timeoutInSeconds\": 300\n         },\n         \"manifestFile\": {\n           \"readerType\": \"MULTIPLEFILESTATEMACHINEREADER\",\n           \"manifestType\": \"S3ReaderS3LinkManifestFile\",\n           \"manifestFileResourceLocation\": \"Customer\",\n           \"manifestFileS3Uri\": \"s3://resonancemanifestfile/resonance_manifest.txt\",\n           \"fileTypes\": [\n             \"WARC\",\n             \"WET\",\n             \"WAT\"\n           ]\n         },\n         \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n         \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n         \"datasetId\": \"3e4fb6efdd494702a6e96f7a844ca4a6\",\n         \"datasetStatus\": \"CREATED\",\n         \"datasetProgress\": {},\n         \"executionLogs\": [],\n         \"createDatetime\": 1680276785644,\n         \"updateDatetime\": 1680276785644\n       }\n     }\n\n

Docs:

Datasets: https://www.letsdata.io/docs/datasets
Read Connectors: https://www.letsdata.io/docs/read-connectors
Manifest: https://www.letsdata.io/docs/manifest-files
Write Connectors: https://www.letsdata.io/docs/write-connectors
Error Connectors: https://www.letsdata.io/docs#errorconnectors
Compute Engine: https://www.letsdata.io/docs/compute-engine
Access Grants: https://www.letsdata.io/docs/access-grants
Customer Access: https://www.letsdata.io/docs/customer-access

\n","urlObject":{"path":["api","dataset","create"],"host":["https://www.letsdata.io"],"query":[],"variable":[]}},"response":[{"id":"27121d26-0766-41cb-ba21-64317c8ce2ce","name":"Validation Errors - Create Dataset","originalRequest":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"body":{"mode":"raw","raw":"{\n \"tenantId\": \"tenantId\",\n \"userId\": \"userId\",\n \"datasetName\": \"APICreateDatasetExample1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"region\": \"us-east-1\",\n \"readConnector\": {\n \"connectorDestination\": \"S3\",\n \"bucketName\": \"commoncrawl\",\n \"bucketResourceLocation\": \"Customer\",\n \"readerType\": \"SINGLEFILEREADER\",\n \"artifactImplementationLanguage\": \"Python\",\n \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_example_functions:latest\",\n \"interfaceECRImageResourceLocation\": \"Customer\"\n },\n \"writeConnector\": {\n \"connectorDestination\": \"Kinesis\",\n \"resourceLocation\": \"letsdata\",\n \"kinesisShardCount\": 1\n },\n \"errorConnector\": {\n \"connectorDestination\": \"S3\",\n \"resourceLocation\": \"letsdata\"\n },\n \"computeEngine\": {\n \"computeEngineType\": \"Lambda\",\n \"concurrency\": 5,\n \"timeoutInSeconds\": 900\n },\n \"manifestFile\": {\n \"manifestType\": \"S3ReaderTextManifestFile\",\n \"readerType\": \"SINGLEFILEREADER\",\n \"fileContents\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00000.warc.wet.gz\\r\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00001.warc.wet.gz\\r\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00002.warc.wet.gz\"\n }\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/dataset/create"},"status":"Bad Request","code":400,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 16:54:52 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"844"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"be3470fb-9152-4f01-9902-ab1d24eb0132"},{"key":"x-amz-apigw-id","value":"UbDYvHr1IAMEcjQ="},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ede5d1-511de90b2068a4aa0f32973f"}],"cookie":[],"responseTime":null,"body":"{\n \"statusCode\": \"ERROR_ACCESS_VALIDATION\",\n \"accessValidation\": {\n \"S3ReadConnector.S3ManifestFileLink.GetObject\": \"SUCCESS\",\n \"S3ReadConnector.ListBucket\": \"SUCCESS\",\n \"S3ReadConnector.GetObject\": \"SUCCESS\",\n \"S3ReadConnector.ManifestObjectsValidation\": \"SUCCESS\",\n \"S3ReadConnector.InterfaceECRImagePath\": \"readConnector.ecrImagePath seems invalid - getECRImage threw exception validateAssertCondition failed - image should not be null\",\n \"S3ReadConnector.interfaceECRImagePath.ValidateClassNames\": \"SUCCESS\",\n \"KinesisWriteConnector.UpdateShardCount\": \"SUCCESS\",\n \"KinesisWriteConnector.PutRecords\": \"SUCCESS\",\n \"KinesisWriteConnector.DescribeStream\": \"SUCCESS\",\n \"S3ErrorConnector.PutObject\": \"SUCCESS\",\n \"S3ErrorConnector.ListBucket\": \"SUCCESS\",\n \"S3ErrorConnector.GetObject\": \"SUCCESS\",\n \"S3ErrorConnector.PutObjectTagging\": \"SUCCESS\",\n \"S3ErrorConnector.GetObjectTagging\": \"SUCCESS\"\n }\n}"},{"id":"3da6f5eb-77ae-4692-badd-2545cc999cba","name":"Success - Create Dataset - Read S3, Write Kinesis, Lambda Compute","originalRequest":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"body":{"mode":"raw","raw":"{\n \"tenantId\": \"tenantId\",\n \"userId\": \"userId\",\n \"datasetName\": \"APICreateDatasetExample1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"region\": \"us-east-1\",\n \"readConnector\": {\n \"connectorDestination\": \"S3\",\n \"bucketName\": \"commoncrawl\",\n \"bucketResourceLocation\": \"Customer\",\n \"readerType\": \"SINGLEFILEREADER\",\n \"artifactImplementationLanguage\": \"Python\",\n \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n \"interfaceECRImageResourceLocation\": \"Customer\"\n },\n \"writeConnector\": {\n \"connectorDestination\": \"Kinesis\",\n \"resourceLocation\": \"letsdata\",\n \"kinesisShardCount\": 1\n },\n \"errorConnector\": {\n \"connectorDestination\": \"S3\",\n \"resourceLocation\": \"letsdata\"\n },\n \"computeEngine\": {\n \"computeEngineType\": \"Lambda\",\n \"concurrency\": 5,\n \"timeoutInSeconds\": 900\n },\n \"manifestFile\": {\n \"manifestType\": \"S3ReaderTextManifestFile\",\n \"readerType\": \"SINGLEFILEREADER\",\n \"fileContents\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00000.warc.wet.gz\\r\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00001.warc.wet.gz\\r\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00002.warc.wet.gz\"\n }\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/dataset/create"},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 16:56:45 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"2523"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"faf54999-b54a-4e5a-bf4f-151c57f068b3"},{"key":"x-amz-apigw-id","value":"UbDq6G2voAMEBvA="},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ede645-742bab271941d239730171cc"}],"cookie":[],"responseTime":null,"body":"{\n \"statusCode\": \"SUCCESS\",\n \"datasetId\": \"199acff350c44fd5a693059e22c0f040\",\n \"accessValidation\": {\n \"S3ReadConnector.S3ManifestFileLink.GetObject\": \"SUCCESS\",\n \"S3ReadConnector.ListBucket\": \"SUCCESS\",\n \"S3ReadConnector.GetObject\": \"SUCCESS\",\n \"S3ReadConnector.ManifestObjectsValidation\": \"SUCCESS\",\n \"S3ReadConnector.InterfaceECRImagePath\": \"SUCCESS\",\n \"S3ReadConnector.interfaceECRImagePath.ValidateClassNames\": \"SUCCESS\",\n \"KinesisWriteConnector.UpdateShardCount\": \"SUCCESS\",\n \"KinesisWriteConnector.PutRecords\": \"SUCCESS\",\n \"KinesisWriteConnector.DescribeStream\": \"SUCCESS\",\n \"S3ErrorConnector.PutObject\": \"SUCCESS\",\n \"S3ErrorConnector.ListBucket\": \"SUCCESS\",\n \"S3ErrorConnector.GetObject\": \"SUCCESS\",\n \"S3ErrorConnector.PutObjectTagging\": \"SUCCESS\",\n \"S3ErrorConnector.GetObjectTagging\": \"SUCCESS\"\n },\n \"dataset\": {\n \"datasetName\": \"APICreateDatasetExample1\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"readConnector\": {\n \"readerType\": \"SINGLEFILEREADER\",\n \"bucketName\": \"commoncrawl\",\n \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n \"connectorDestination\": \"S3\",\n \"interfaceECRImageResourceLocation\": \"Customer\",\n \"artifactImplementationLanguage\": \"PYTHON\",\n \"region\": \"us-east-1\",\n \"bucketResourceLocation\": \"Customer\"\n },\n \"writeConnector\": {\n \"connectorDestination\": \"KINESIS\",\n \"kinesisShardCount\": 1,\n \"kinesisStreamName\": \"tldwc199acff350c44fd5a693059e22c0f040\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"errorConnector\": {\n \"bucketName\": \"tldec199acff350c44fd5a693059e22c0f040\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA\",\n \"memoryLimitInMegabytes\": 5120,\n \"concurrency\": 5,\n \"timeoutInSeconds\": 900\n },\n \"manifestFile\": {\n \"readerType\": \"SINGLEFILEREADER\",\n \"manifestType\": \"S3ReaderTextManifestFile\",\n \"region\": \"us-east-1\",\n \"fileContents\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00000.warc.wet.gz\\r\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00001.warc.wet.gz\\r\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00002.warc.wet.gz\"\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"199acff350c44fd5a693059e22c0f040\",\n \"datasetStatus\": \"CREATED\",\n \"datasetProgress\": {},\n \"executionLogs\": [],\n \"createDatetime\": 1710089797929,\n \"updateDatetime\": 1710089797929\n }\n}"}],"_postman_id":"2fcc920c-dab7-41ae-9902-fb711f5e19ba"}],"id":"e730c9c8-8933-4e3c-ae04-054f8519096b","description":"

The `create` sub resource for dataset

\n","_postman_id":"e730c9c8-8933-4e3c-ae04-054f8519096b"},{"name":"delete","item":[{"name":"View Status of Delete Request","id":"2f832ab3-a115-49d7-89c1-d9d597829bd3","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/dataset/delete?tenantId=tenantId&userId=userId&datasetName=IndexWebCrawlDataDec2022&datasetId=27251ad51f2addb2e3952cbbe12d97dc&deleteType=DELETE","description":"

dataset/delete GET

View the progress of a dataset's descale/freeze/delete workflow by issuing a GET on the dataset/delete resource.

Input Parameters:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For Example, 078260ed-3124-4de0-8eee-cc5b5025e7ad (TODO - this can be optional, API gets it from token)
datasetName: The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022
datasetId: The datasetId for the dataset the user wants to run the command for. For example, 27251ad51f2addb2e3952cbbe12d97dc. The datasetId can be retrieved from the dataset JSON returned by the View Dataset command (GET dataset)
deleteType: The deleteType for the dataset deletion. Allowed values: [DESCALED, FROZEN, DELETE]

Example

api/dataset/delete?tenantId=d5feaf90-71a9-41ee-b1b9-35e4242c3155&userId=accb3567-2b6e-41ae-b00d-6ce1f9a58d94&datasetName=IndexWebCrawlDataDec2022&datasetId=27251ad51f2addb2e3952cbbe12d97dc&deleteType=DELETE\n\n

Output Parameters:

The HttpStatusCode of the response can be looked at to determine success / error. The response body is JSON that has details about the dataset and the delete status. The response body JSON has the following schema:

    {\n        \"deleteStatus\":\n        {\n            \"tenantId\": \"the dataset's tenantId\",\n            \"userId\": \"the dataset's userId\",\n            \"datasetName\": \"the datasetName\",\n            \"datasetId\": \"the datasetId\",\n            \"requestType\": \"DESCALE|FREEZE|DELETE\",\n            \"requestId\": \"the requestId\",\n            \"requestStatus\": \"the status of the request - Allowed values: [CREATED, PROCESSING, COMPLETE, ERROR]\",\n            \"deleteType\": \"the deleteType - Allowed values: [DESCALE, FREEZE, DELETE]\",\n            \"errors\": [\n                \"String - error messages in case the delete had errors\",\n                ...\n            ]\n        },\n        \"dataset\":\n        {\n            \"tenantId\": \"String\",\n            \"userId\": \"String\",\n            \"datasetName\": \"String\",\n            \"region\": \"String\",\n            \"accessGrantRoleArn\": \"String\",\n            \"customerAccountForAccess\": \"String\",\n            \"readConnector\": {\n                ...\n            },\n            \"writeConnector\": {\n                ...\n            },\n            \"errorConnector\": {\n                ...\n            },\n            \"computeEngine\": {\n                ...\n            },\n            \"manifestFile\": {\n                ...\n            }\n        }\n    }\n\n

dataset: This is the dataset json document that has details about the read, write and error connectors, the manifest file, the compute engine, access grants and system's internal details about the datasetStatus, progress and execution logs. datasetStatus should tell you the latest state the dataset is in. Details at: https://www.letsdata.io/docs#datasets
deleteStatus: The status of the delete request. deleteStatus.requestStatus should inform you about the current status of the delete request (CREATED, PROCESSING, COMPLETE, ERROR). If there are any errors in deletion, they should appear in the deleteStatus.errors list. The remaining attributes are echo of the request parameters.

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

Request successfully retrieved the delete status for the dataset. The response body has the datasetStatus and the dataset details.

  {\n    \"deleteStatus\":\n    {\n        \"tenantId\": \"the dataset's tenantId\",\n        \"userId\": \"the dataset's userId\",\n        \"datasetName\": \"the datasetName\",\n        \"datasetId\": \"the datasetId\",\n        \"requestType\": \"DESCALE|FREEZE|DELETE\",\n        \"requestId\": \"the requestId\",\n        \"requestStatus\": \"the status of the request - Allowed values: [CREATED, PROCESSING, COMPLETE, ERROR]\",\n        \"deleteType\": \"the deleteType - Allowed values: [DESCALE, FREEZE, DELETE]\",\n        \"errors\": [\n            \"String - error messages in case the delete had errors\",\n            ...\n        ]\n    },\n    \"dataset\":\n    {\n        \"tenantId\": \"String\",\n        \"userId\": \"String\",\n        \"datasetName\": \"String\",\n        \"region\": \"String\",\n        \"accessGrantRoleArn\": \"String\",\n        \"customerAccountForAccess\": \"String\",\n        \"readConnector\": {\n            ...\n        },\n        \"writeConnector\": {\n            ...\n        },\n        \"errorConnector\": {\n            ...\n        },\n        \"computeEngine\": {\n            ...\n        },\n        \"manifestFile\": {\n            ...\n        }\n    }\n  }\n\n

404:

The dataset for the tenantId, userId and datasetName was not found in the database. An empty datasetStatus and dataset is returned in the response JSON.
\n
```
  {\n    \"deleteStatus\": { },\n    \"dataset\": { }\n  }\n\n
```
\n

The dataset exists but the delete request for the deleteType does not exist in the database. In this case, dataset details are returned with an empty datasetStatus JSON.

  {\n    \"deleteStatus\": { },\n    \"dataset\":\n    {\n        \"tenantId\": \"String\",\n        \"userId\": \"String\",\n        \"datasetName\": \"String\",\n        \"region\": \"String\",\n        \"accessGrantRoleArn\": \"String\",\n        \"customerAccountForAccess\": \"String\",\n        \"readConnector\": {\n            ...\n        },\n        \"writeConnector\": {\n            ...\n        },\n        \"errorConnector\": {\n            ...\n        },\n        \"computeEngine\": {\n            ...\n        },\n        \"manifestFile\": {\n            ...\n        }\n    }\n  }\n\n

500:
\n
- An unexpected error has occurred.
  \n
```
  {\n  \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n  \"message\": \"Internal Server Error, please try again later.\"\n  }\n\n
```
  \n
- In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
  \n
\n

Details:

Descale, Freeze and Delete are related concepts and the APIs are similar as well. Here is the dataset lifecycle diagram for Descale/Freeze and Delete states.

                                         +-----------------------+\n         +---<---+-<---+-<---------------|  8. Dataset Completed |\n         |           |             |     +-----------------------+\n         V           V             V\n     9. Descale      |             |\n      ^  |           |             |\n      |  |           |             |\n      |  V           V             V\n      |  +--- > 10. Freeze         |\n      ^            ^   |           |\n      |            |   |           |\n      |            |   V           V                             +--------------------+\n      |            |   +------ > 11. Delete  <-----<-----+---<---| 5. Dataset Errored |\n      ^            ^                                     |       +--------------------+\n      |            |                                     |\n      |            |                                     V\n      +--<---------+--------<-----------<-----------<----+\n\n

Here is a comparison of how the initialized resources are descaled / reclaimed for descale / freeze / delete.

----------------------------+-----------------------------------------------------+------------------------------------+----------------------------------------------------------------\n                            |    DESCALE                                          |    FREEZE                          |     DELETE\n----------------------------+-----------------------------------------------------+------------------------------------+----------------------------------------------------------------\nCustomerAccountForAccess    |    No Change                                        |     No Change                      | Access Revoked\nError Connector             |    No Change                                        |     No Change                      | Delete error documents & Delete Bucket (if let's data managed)\nWrite Connector             |    Update ShardCount to 1                           |     Delete Stream                  | Delete Stream\nDataTask Execute Lambda     |    No Change (TODO: Fix by descale concurrency)     |     Deleted                        | Deleted\nMetrics                     |    Archived                                         |     Archived                       | Archived (TODO: Fix, should not be archived)\nImplementationJarS3Artifact |    No Change                                        |     Delete internal copy           | Delete internal copy\nInternal Queues             |    No Change                                        |     Deleted                        | Deleted\nInternal Task Database      |    Provisioned Throughput Reduced                   |     Tasks Archived & DB Deleted    | Archived & DB Deleted\nInternal Resource Map       |    No Change                                        |     Deleted                        | Deleted\nTask State Monitor Process  |    No Change                                        |     Deleted                        | Deleted\nCode Builds                 |    No Change                                        |     Deleted                        | Deleted\nBuild Project               |    No Change                                        |     Deleted                        | Deleted\nSource Code Branch          |    No Change                                        |     Deleted                        | Deleted\n\n

(TODO: Viewing a delete request at this time shows only the status (Completed, Processing, Error etc) along with some text errors in case there were errors. We'd like to update this API with details about each step in the descale / freeze / delete workflow, similar to initialization and redrive workflows. Users can expect this API to change with workflow details similar to initialization / redrive for the delete workflows as well.)

Docs:

You can learn about Datasets and their lifecycle at: https://www.letsdata.io/docs/datasets

You can learn about Cost Management workflows at: https://www.letsdata.io/docs/cost-management

\n","urlObject":{"path":["api","dataset","delete"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

\n","type":"text/plain"},"key":"userId","value":"userId"},{"description":{"content":"

The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022

\n","type":"text/plain"},"key":"datasetName","value":"IndexWebCrawlDataDec2022"},{"description":{"content":"

The datasetId for the dataset the user wants to run the command for. The datasetId can be retrieved from the dataset JSON returned by the View Dataset command (GET /dataset)

\n","type":"text/plain"},"key":"datasetId","value":"27251ad51f2addb2e3952cbbe12d97dc"},{"description":{"content":"

The deleteType for the dataset deletion. Allowed values: [DESCALED, FROZEN, DELETE]

\n","type":"text/plain"},"key":"deleteType","value":"DELETE"}],"variable":[]}},"response":[{"id":"2c23eb82-bcf0-48c3-99ca-684fa9a9be01","name":"Example - View Status of Delete Request","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/dataset/delete?tenantId=tenantId&userId=userId&datasetName=APICreateDatasetExample1&datasetId=199acff350c44fd5a693059e22c0f040&deleteType=DELETE","host":["https://www.letsdata.io"],"path":["api","dataset","delete"],"query":[{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner."},{"key":"datasetName","value":"APICreateDatasetExample1","description":"The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022"},{"key":"datasetId","value":"199acff350c44fd5a693059e22c0f040","description":"The datasetId for the dataset the user wants to run the command for. The datasetId can be retrieved from the dataset JSON returned by the View Dataset command (GET /dataset)"},{"key":"deleteType","value":"DELETE","description":"The deleteType for the dataset deletion. Allowed values: [DESCALED, FROZEN, DELETE]"}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:23:39 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"2385"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"3af84a62-fc01-4b1e-802f-8306450259b8"},{"key":"x-amz-apigw-id","value":"Ubh-3F5ioAMECbQ="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee16c5-2dbebfaa37df2dea60207dfd"}],"cookie":[],"responseTime":null,"body":"{\n \"deleteStatus\": {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"APICreateDatasetExample1\",\n \"datasetId\": \"199acff350c44fd5a693059e22c0f040\",\n \"requestType\": \"DELETE\",\n \"requestId\": \"199acff350c44fd5a693059e22c0f040DELETE\",\n \"requestStatus\": \"PROCESSING\",\n \"createDatetime\": 1710102181693,\n \"updateDatetime\": 1710102197873,\n \"deleteType\": \"DELETE\"\n },\n \"dataset\": {\n \"datasetName\": \"APICreateDatasetExample1\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"customerAccessRoleArn\": \"arn:aws:iam::223413462631:role/TestCustomerAccess199acff350c44fd5a693059e22c0f040IAMRole\",\n \"readConnector\": {\n \"readerType\": \"SINGLEFILEREADER\",\n \"bucketName\": \"commoncrawl\",\n \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n \"connectorDestination\": \"S3\",\n \"interfaceECRImageResourceLocation\": \"Customer\",\n \"artifactImplementationLanguage\": \"PYTHON\",\n \"region\": \"us-east-1\",\n \"bucketResourceLocation\": \"Customer\"\n },\n \"writeConnector\": {\n \"connectorDestination\": \"KINESIS\",\n \"kinesisShardCount\": 1,\n \"kinesisStreamName\": \"tldwc199acff350c44fd5a693059e22c0f040\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"errorConnector\": {\n \"bucketName\": \"tldec199acff350c44fd5a693059e22c0f040\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA\",\n \"memoryLimitInMegabytes\": 5120,\n \"concurrency\": 5,\n \"timeoutInSeconds\": 900\n },\n \"manifestFile\": {\n \"readerType\": \"SINGLEFILEREADER\",\n \"manifestType\": \"S3ReaderTextManifestFile\",\n \"region\": \"us-east-1\",\n \"fileContents\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00000.warc.wet.gz\\r\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00001.warc.wet.gz\\r\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00002.warc.wet.gz\"\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"199acff350c44fd5a693059e22c0f040\",\n \"datasetStatus\": \"DELETING\",\n \"datasetProgress\": {\n \"totalTasks\": 1,\n \"completedTasks\": 1,\n \"errorTasks\": 0\n },\n \"executionLogs\": [\n {\n \"startDatetime\": 1710091140895,\n \"endDatetime\": 1710091719300\n }\n ],\n \"createDatetime\": 1710089797929,\n \"updateDatetime\": 1710102181712\n }\n}"}],"_postman_id":"2f832ab3-a115-49d7-89c1-d9d597829bd3"},{"name":"Delete a Dataset","id":"2d23b486-7879-4981-a332-533f990e5404","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"body":{"mode":"raw","raw":"{\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"IndexWebCrawlDataDec2022\",\n \"datasetId\": \"27251ad51f2addb2e3952cbbe12d97dc\",\n \"deleteType\": \"DELETE\"\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/dataset/delete","description":"

datasets/delete - POST

A dataset that has completed processing (is in the COMPLETED or ERRORED terminal states) or is in PROCESSING state can be \"deleted\". We support a few different types of \"delete\" - DESCALED, FROZEN and DELETE. Here is what each of these mean:

DESCALED: This is when dataset has completed processing (success or error) and user / cost management service has decided to descale (different from reclaimed) the resources that were allocated for the dataset. For example, provisioned throughputs are decreased, lambda concurrency reclaimed etc. Though not supported yet, but dataset in this state can have its resources re-hydrated to rerun tasks etc if needed.
FROZEN: This is when the dataset has completed processing and the user / cost management service has decided to reclaim the resources that were allocated for the dataset. For example, internal queues are deleted, processing tables are deleted and any non user data infrastructure is reclaimed. Things such as user data in write destination and error destinations are still available though - this means that the dataset is essentially read-only and dataset consumers can continue processing from a frozen dataset. A frozen dataset cannot be re-hydrated.
DELETE: This is when the user has decided to delete the dataset - all resources are reclaimed. Zombie records are kept to disallow recreation and aid delayed processes such as billing etc.

When a dataset is \"deleted\", it kicks off a descale/freeze/delete workflow which descales/freezes/deletes the different resources. You can view the progress of a this workflow by issuing a GET on the dataset/delete resource (see its docs for details).

Input Parameters:

The POST body is a JSON request that has the following schema:

{\n    \"tenantId\": \"tenantId of the dataset\",\n    \"userId\": \"userId of the dataset owner\",\n    \"datasetName\": \"the dataset name \",\n    \"datasetId\": \"the datasetId\",\n    \"deleteType\": \"the deleteType - Allowed Values: [DESCALED, FROZEN, DELETE]\"\n}\n\n

Here are the details for the JSON request schema:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For Example, --userId 078260ed-3124-4de0-8eee-cc5b5025e7ad (TODO - this can be optional, API gets it from token)
datasetName: The dataset name for the dataset that the user wants to run the command for.
datasetId: The datasetId for the dataset the user wants to run the command for. The datasetId can be retrieved from the dataset JSON returned by the View Dataset command (GET /dataset)
deleteType: The deleteType for the dataset deletion. Allowed values: [DESCALED, FROZEN, DELETE]
- DESCALED: This is when dataset has completed processing (success or error) and user / cost management service has decided to descale (different from reclaimed) the resources that were allocated for the dataset. For example, provisioned throughputs are decreased, lambda concurrency reclaimed etc. Though not supported yet, but dataset in this state can have its resources re-hydrated to rerun tasks etc if needed.
- FROZEN: This is when the dataset has completed processing and the user / cost management service has decided to reclaim the resources that were allocated for the dataset. For example, internal queues are deleted, processing tables are deleted and any non user data infrastructure is reclaimed. Things such as user data in write destination and error destinations are still available though - this means that the dataset is essentially read-only and dataset consumers can continue processing from a frozen dataset. A frozen dataset cannot be re-hydrated.
- DELETE: This is when the user has decided to delete the dataset - all resources are reclaimed. Zombie records are kept to disallow recreation and aid delayed processes such as billing etc.
\n

For example, a POST request to the dataset/delete resource with the following body would process the dataset named IndexWebCrawlDataDec2022 with datasetId 27251ad51f2addb2e3952cbbe12d97dc belonging to the tenant (tenantId: d5feaf90-71a9-41ee-b1b9-35e4242c3155) and user (userId: accb3567-2b6e-41ae-b00d-6ce1f9a58d94) for the given deleteType (DELETE) :

{\n    \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n    \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n    \"datasetName\": \"IndexWebCrawlDataDec2022\",\n    \"datasetId\": \"27251ad51f2addb2e3952cbbe12d97dc\",\n    \"deleteType\": \"DELETE\"\n}\n\n

Output Parameters:

The HttpStatusCode of the response can be looked at to determine success / error. The response body is JSON that has extended information about the request and includes a statusCode and a message. The response body JSON has the following schema:

{\n    \"statusCode\": \"SUCCESS|ERROR|PROCESSING|REQUEST_ALREADY_ENQUEUED|CONCURRENT_REQUEST_IN_PROGRESS|NOT_ALLOWED_AT_THIS_TIME|INTERNAL_SERVER_ERROR\",\n    \"message\": \"String\"\n}\n\n

statusCode: StatusCode of the request - this can be either UCCESS|ERROR|PROCESSING|REQUEST_ALREADY_ENQUEUED|CONCURRENT_REQUEST_IN_PROGRESS|NOT_ALLOWED_AT_THIS_TIME|INTERNAL_SERVER_ERROR. In each of these cases, the Message string has additional details about the status. For example, if a dataset is being FROZEN and you attempt to delete, the statusCode will be ERROR and the message would indicate that the delete request is invalid because of a concurrent delete. At any given time, we allow 1 type of descale/freeze and delete operation and there is a rank order in the descale(1)/freeze(2)/delete(3) states which enforces that a request for a datasetStatus (lower in rank) when the dataset's status is higher rank is disallowed. For example, FROZEN/DELETED workflows cannot be descaled etc and would result in ERROR.
message: The error / success message that has the details about the status of the request.

Here are the different HttpStatusCodes that are returned and their sub cases:

102:

Request was enqueued earlier and is now PROCESSING

        {\n            \"statusCode\": \"PROCESSING\",\n            \"message\": \"dataset delete request to <deleteType> the dataset is being processed.\"\n        }\n\n

200:

Request has already been processed successfully for the deleteType

        {\n            \"statusCode\": \"SUCCESS\",\n            \"message\": \"Dataset has been processed for delete type <deleteType>\"\n        }\n\n

Request was successfully enqueued

        {\n            \"statusCode\": \"SUCCESS\",\n            \"message\": \"<deleteType> request successfully enqueued.\" \n        }\n\n

Request has already been enqueued for the deleteType

        {\n            \"statusCode\": \"REQUEST_ALREADY_ENQUEUED\",\n            \"message\": \"The request to <deleteType> has already been enqueued in the system.\"\n        }\n\n

400:
\n
- Request is not allowed at this time since a different deleteType request is currently in progress for the dataset. (one in progress delete request allowed at a time)
  \n
```
        {\n            \"statusCode\": \"ERROR\",\n            \"message\": \"dataset delete request to <deleteType> is invalid since another dataset deletion request to <different deleteType> the dataset is currently in progress.\"\n        }\n\n
```
  \n
- Request is not allowed at this time since it is invalid - a higher precedence request has already been processed by the dataset. For example, a request to freeze the dataset is invalid if the dataset had already been processed for delete. (freeze is lower precedence than delete). See details for deleteType precedence.
  \n
```
        {\n            \"statusCode\": \"ERROR\",\n            \"message\": \"dataset delete request to <deleteType> is invalid since dataset has already been processed for <higher precedence deleteType>\"\n        }\n\n
```
  \n
- Request is not allowed at this time since a deleteType request is already in progress. (This should not happen for deletes since two requests to freeze are identical, however, framework throws this for update cases other than deletes. Listing for completeness)
  \n
```
        {\n            \"statusCode\": \"CONCURRENT_REQUEST_IN_PROGRESS\",\n            \"message\": \"The system is currently working on a different <deleteType> request. Check to see if the request is a duplicate of the existing request. enqueuedRequest: <enqueuedRequest>, requested: <requested>\" \n        }\n\n
```
  \n
- Request is not allowed at this time since a concurrent update request is in progress (for example, update code, update compute configuration, redriving etc)
  \n
```
        {\n            \"statusCode\": \"CONCURRENT_REQUEST_IN_PROGRESS\",\n            \"message\": \"A concurrent request is being processed by the system. enqueuedRequest: <enqueuedRequest>\" \n        }\n\n
```
  \n
- Request is not allowed at this time since the current datasetStatus does not allow deletes of deleteType.
  \n
  - In-Progress Statuses [STOPPING_ERROR, STOPPING_COMPLETE, DELETING, DESCALING, FREEZING, REDRIVING, UPDATING] disallow all deleteTypes (Descale, Freeze, Delete).
    \n
  - datasetStatus DELETED disallows all deleteTypes (Descale, Freeze, Delete)
    \n
  - datasetStatus FROZEN disallows (Descale, Freeze) deleteTypes
    \n
  - datasetStatus DESCALED disallows (Descale) deleteType
    \n
  - datasetStatus CREATED & INITIALIZING disallows (Descale, Freeze) deleteTypes
    \n
  - datasetStatus PROCESSING disallows (Descale) deleteTypes
    \n
```
      {\n          \"statusCode\": \"NOT_ALLOWED_AT_THIS_TIME\",\n          \"message\": \"Dataset is currently in <datasetStatus> state. <deleteType> is not allowed in this state.\"\n      }\n\n
```
    \n
  \n
\n

404:

The dataset for the tenantId, userId and datasetName was not found in the database.

    {\n        \"statusCode\": \"NOT_FOUND\",\n        \"message\": \"Dataset not found for the tenantId: <tenantId>, userId: <userId>, datasetName: <datasetName>\"  \n    }\n\n

409:

Request could not be written to the database, possibly due to db conflict. Retrying may fix the issue.

        {\n            \"statusCode\": \"ERROR\",\n            \"message\": \"<deleteType> request could not be queued - errorCode: <dbErrorCode>\"  \n        }\n\n

500:

Request was enqueued earlier and failed with an error

        {\n            \"statusCode\": \"ERROR\",\n            \"message\": \"dataset delete request to <deleteType> the dataset has had an error.\"\n        }\n\n

An unexpected error has occurred.

        {\n            \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n            \"message\": \"Internal Server Error, please try again later.\"  \n        }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
\n

View the status of the request by issuing a GET on the dataset/delete resource (see 'View Status of Delete Request' docs for details).

Details:

Descale, Freeze and Delete are related concepts and the APIs are similar as well. Here is the dataset lifecycle diagram for Descale/Freeze and Delete states.

                                         +-----------------------+\n         +---<---+-<---+-<---------------|  8. Dataset Completed |\n         |           |             |     +-----------------------+\n         V           V             V\n     9. Descale      |             |\n      ^  |           |             |\n      |  |           |             |\n      |  V           V             V\n      |  +->       --> 10. Freeze         |\n      ^            ^   |           |\n      |            |   |           |\n      |            |   V           V                             +--------------------+\n      |            |   +       -->--       --> 11. Delete  <-----<-----+---<---| 5. Dataset Errored |\n      ^            ^                                     |       +--------------------+\n      |            |                                     |\n      |            |                                     V\n      +--<---------+--------<-----------<-----------<----+\n\n

Here is a comparison of how the initialized resources are descaled / reclaimed for descale / freeze / delete.

----------------------------+-----------------------------------------------------+------------------------------------+----------------------------------------------------------------\n                            |    DESCALE                                          |    FREEZE                          |     DELETE\n----------------------------+-----------------------------------------------------+------------------------------------+----------------------------------------------------------------\nCustomerAccountForAccess    |    No Change                                        |     No Change                      | Access Revoked\nError Connector             |    No Change                                        |     No Change                      | Delete error documents & Delete Bucket (if let's data managed)\nWrite Connector             |    Update ShardCount to 1                           |     Delete Stream                  | Delete Stream\nDataTask Execute Lambda     |    No Change (TODO: Fix by descale concurrency)     |     Deleted                        | Deleted\nMetrics                     |    Archived                                         |     Archived                       | Archived (TODO: Fix, should not be archived)\nImplementationJarS3Artifact |    No Change                                        |     Delete internal copy           | Delete internal copy\nInternal Queues             |    No Change                                        |     Deleted                        | Deleted\nInternal Task Database      |    Provisioned Throughput Reduced                   |     Tasks Archived & DB Deleted    | Archived & DB Deleted\nInternal Resource Map       |    No Change                                        |     Deleted                        | Deleted\nTask State Monitor Process  |    No Change                                        |     Deleted                        | Deleted\nCode Builds                 |    No Change                                        |     Deleted                        | Deleted\nBuild Project               |    No Change                                        |     Deleted                        | Deleted\nSource Code Branch          |    No Change                                        |     Deleted                        | Deleted\n\n

Docs:

You can learn about Datasets and their lifecycle at: https://www.letsdata.io/docs/datasets

You can learn about Cost Management workflows at: https://www.letsdata.io/docs/cost-management

\n","urlObject":{"path":["api","dataset","delete"],"host":["https://www.letsdata.io"],"query":[],"variable":[]}},"response":[{"id":"adc34886-c3bd-45d7-9f29-0872be514806","name":"Example - Delete a Dataset","originalRequest":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"body":{"mode":"raw","raw":"{\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"APICreateDatasetExample1\",\n \"datasetId\": \"199acff350c44fd5a693059e22c0f040\",\n \"deleteType\": \"DELETE\"\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/dataset/delete"},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:23:01 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"74"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"e54c9e01-eef7-4761-9df7-425136e5d50e"},{"key":"x-amz-apigw-id","value":"Ubh5BFtYIAMEtgQ="},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee169f-19cd0a6f4edc6fd84961a328"}],"cookie":[],"responseTime":null,"body":"{\n \"statusCode\": \"SUCCESS\",\n \"message\": \"DELETE request successfully enqueued.\"\n}"}],"_postman_id":"2d23b486-7879-4981-a332-533f990e5404"}],"id":"eac7ea78-e029-42af-a0f8-489b905a2cb8","description":"

The delete sub resource for the dataset.

\n","_postman_id":"eac7ea78-e029-42af-a0f8-489b905a2cb8"},{"name":"code","item":[{"name":"Update Dataset Code","id":"35c39171-ce73-411e-8731-1ef9f6bcba07","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"body":{"mode":"raw","raw":" {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"IndexWebCrawlDataDec2022\",\n \"artifactFileS3Link\": \"s3://index-web-crawl-dataset-test/letsdata-index-web-crawl-1.0-SNAPSHOT.jar\",\n \"artifactFileS3LinkResourceLocation\": \"Customer\",\n \"artifactFileAccessGrantedRoleArn\": \"arn:aws:iam::151166716410:role/LetsData_AccessRole_CommonCrawlDatasetTest8\"\n }","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/dataset/code","description":"

datasets/code - POST

A dataset that in in ERRORED status can be updated with new code artifact - either a JAR File or ECR Image. This is when the user has decided to fix the user data handler code to possibly fix the errors or update the code for different scenarios. This does kick off a Update Dataset Code workflow which will deploy that code as the function's implementation. You can view the progress of a this workflow by issuing a GET on the dataset/code resource (see its docs for details).

Input Parameters:

The API can be used to either a JAR File or ECR Image. The POST body JSON differs slightly for JAR File Update vs ECR Image Update.

The POST body for a JSON request to update the JAR File that has the following schema:

      {\n        \"tenantId\": \"the dataset's tenantId\",\n        \"userId\": \"the dataset's userId\",\n        \"datasetName\": \"the datasetName\",\n        \"artifactFileS3Link\": \"the s3 link for the code JAR file\",\n        \"artifactFileS3LinkResourceLocation\": \"The resourceLocation for the artifactFileS3Link. Valid values are: [Customer, LetsData]\",\n        \"artifactFileAccessGrantedRoleArn\": \"the role arn that should be used to access the JAR file. Required when resourceLocation is Customer. Not Required when resourceLocation is LetsData.\"\n      }\n\n

The POST body for a JSON request to update the ECR Image that has the following schema:

      {\n        \"tenantId\": \"the dataset's tenantId\",\n        \"userId\": \"the dataset's userId\",\n        \"datasetName\": \"the datasetName\",\n        \"interfaceECRImagePath\": \"The ECR Image path for the update\",\n        \"interfaceECRImageResourceLocation\": \"The resourceLocation for the ECR Image. Valid values are: [Customer, LetsData]\"\n      }    \n\n

Here are the details for the JSON request schema:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For Example, --userId 078260ed-3124-4de0-8eee-cc5b5025e7ad (TODO - this can be optional, API gets it from token)
datasetName: The dataset name for the dataset that the user wants to run the command for.
artifactFileS3Link: The S3 Link for code JAR that is being updated for the dataset. For example, 's3://index-web-crawl-dataset-test/letsdata-index-web-crawl-1.0-SNAPSHOT.jar'. Either artifactFileS3Link or interfaceECRImagePath is required.'
artifactFileS3LinkResourceLocation: The resourceLocation string for the artifactFileS3Link to specify whether the JAR at S3 link is in Customer account or LetsData account. Valid values are: [\"Customer\", \"LetsData\"]
artifactFileS3LinkAccessGrantRoleArn: The access grant role arn required to access the code JAR at the S3 link. Required when artifactFileS3LinkResourceLocation is set to Customer. Not Required when artifactFileS3LinkResourceLocation is set to LetsData. See the AccessGrants documentation to learn how to create a role to allow access to #Lets Data - https://www.letsdata.io/docs#accessgrants. For example, \"artifactFileS3LinkAccessGrantRoleArn\": \"arn:aws:iam::151166716410:role/LetsData_AccessRole_CommonCrawlDatasetTest8\", LetsData would use IAM Role arn:aws:iam::151166716410:role/LetsData_AccessRole_CommonCrawlDatasetTest8 to access the artifact.
interfaceECRImagePath: The ECR Image path for the ECR Image that is being updated for the dataset. For example, '151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest'.
interfaceECRImageResourceLocation: The resourceLocation string for the interfaceECRImagePath to specify whether the ECR Image is in Customer account or LetsData account. Valid values are: [\"Customer\", \"LetsData\"]

Examples:

Update Code JAR: For example, a POST request to the dataset/code resource with the following body would update the code jar for the dataset named IndexWebCrawlDataDec2022 belonging to the tenant (tenantId: d5feaf90-71a9-41ee-b1b9-35e4242c3155) and user (userId: accb3567-2b6e-41ae-b00d-6ce1f9a58d94). The updated code JAR is accessed from s3 link s3://index-web-crawl-dataset-test/letsdata-index-web-crawl-1.0-SNAPSHOT.jar in the Customer AWS account using the IAM Role arn:aws:iam::151166716410:role/LetsData_AccessRole_CommonCrawlDatasetTest8:
\n
```
      {\n        \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n        \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n        \"datasetName\": \"IndexWebCrawlDataDec2022\",\n        \"artifactFileS3Link\": \"s3://index-web-crawl-dataset-test/letsdata-index-web-crawl-1.0-SNAPSHOT.jar\",\n        \"artifactFileS3LinkResourceLocation\": \"Customer\",\n        \"artifactFileAccessGrantedRoleArn\": \"arn:aws:iam::151166716410:role/LetsData_AccessRole_CommonCrawlDatasetTest8\"\n      }\n\n
```
\n
Update ECR Image: For example, a POST request to the dataset/code resource with the following body would update the ECR Image for the dataset named IndexWebCrawlDataDec2022 belonging to the tenant (tenantId: d5feaf90-71a9-41ee-b1b9-35e4242c3155) and user (userId: accb3567-2b6e-41ae-b00d-6ce1f9a58d94). The updated ECR Image is accessed from ECR path s3://index-web-crawl-dataset-test/letsdata-index-web-crawl-1.0-SNAPSHOT.jar in the Customer AWS account (The ECR Repo has already been configured to grant access to LetsData - See ECR Image Access Grants):
\n
```
      {\n        \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n        \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n        \"datasetName\": \"IndexWebCrawlDataDec2022\",\n        \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n        \"interfaceECRImageResourceLocation\": \"Customer\"\n      }\n\n
```
\n

Output Parameters:

The HttpStatusCode of the response can be looked at to determine success / error. The response body is JSON that has the status of the update request. The response body JSON has the following schema:

    {\n        \"statusCode\": \"<SUCCESS|ERROR>\",\n        \"message\": \"String\",\n        \"updateDatasetCodeRequest\":\n        {\n            \"tenantId\": \"String\",\n            \"userId\": \"String\",\n            \"datasetName\": \"String\",\n            \"datasetId\": \"String\",\n            \"requestType\": \"String\",\n            \"requestId\": \"String\",\n            \"requestStatus\": \"String\",\n            \"createDatetime\": \"Long\",\n            \"updateDatetime\": \"Long\",\n            \"artifactFileS3Link\": \"String\",\n            \"artifactFileS3LinkAccessGrantedRoleArn\": \"String\",\n            \"artifactFileS3LinkResourceLocation\": \"String\",\n            \"interfaceECRImagePath\": \"String\",\n            \"interfaceECRImageResourceLocation\": \"String\"\n        }\n    }\n\n

statusCode: StatusCode of the request - this can be either SUCCESS or ERROR. In each of these cases, the Message string has additional details about the status.
message: The error / success message that has the details about the status of the request.
updateDatasetCodeRequest: For a success response, an updateDatasetCodeRequest map is returned which has the request details. The important properties in this request map are the requestStatus and the requestId. The requestId is essentially the content hash of the artifact / imageId of the ECR Image which can be used to de-duplicate update dataset code requests. The requestId can be used to view the status of the update requests by issuing a GET on the dataset/code resource (see docs for details).

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

update code request i.) has been successfully processed ii.) already been enqueued iii.) currently being processed iv.) completed with errors

      {\n        \"statusCode\": \"ERROR\",\n        \"message\": \"UpdateDatasetCode request for artifact at link <artifactName> with content hash <requestId> has been successfully processed by the system.|\n                  UpdateDatasetCode request for artifact at link <artifactName> with content hash <requestId> has already been enqueued in the system.|\n                  UpdateDatasetCode request for artifact at link <artifactName> with content hash <requestId> is currently being processed by the system.|\n                  UpdateDatasetCode request for artifact at link <artifactName> with content hash <requestId> has completed with errors.\"\n        \"updateDatasetCodeRequest\":\n        {\n          ... // the update code request in the database\n        }\n      }\n\n

Request was successfully enqueued

            {\n                \"statusCode\": \"SUCCESS\",\n                \"message\": \"<deleteType> request successfully enqueued.\"\n                \"updateDatasetCodeRequest\":\n                {\n                  ... // the update code request from the api call\n                }\n            }\n\n

400

ECR Image Validation Errors

      {\n        \"statusCode\": \"ERROR\",\n        \"message\": \"readConnector.ecrImagePath seems invalid - getECRImage threw exception <exceptionMessage>|\n                  readConnector.ecrImagePath - could not parse the image manifest - <exceptionMessage>|\n                  readConnector.ecrImagePath - getDownloadUrlForLayer threw exception - <exceptionMessage>\"\n      }\n\n

JAR File Validation Errors

      {\n        \"statusCode\": \"ERROR\",\n        \"message\": \"ArtifactFileS3Link is not a valid Amazon S3 URI. Filetype implementation not verified in the jar file. This will be validated again when the ArtifactFileS3Link errors are fixed|\n                  Access is denied to the ArtifactFileS3Link - bucketName: <bucketName>, objectKey: <objectKey>|\n                  ArtifactFileS3Link object key does not exist in the bucket - bucketName: <bucketName>, objectKey: <objectKey>|\n                  ArtifactFileS3Link bucket does not exist - bucketName: <bucketName>|\n                  ArtifactFileS3Link - unknown error when attempting to read the jar file from the bucket - bucketName: <bucketName>, objectKey: <objectKey>|\n                  The artifact jar at the S3Link does not contain the filetype implementation classes - bucketName: <bucketName>, objectKey: <objectKey>, filetypeImplementations not validated:  [ <classNames failing validation>]\"\n      }\n\n

404:

The dataset for the tenantId, userId and datasetName was not found in the database.

          {\n              \"statusCode\": \"NOT_FOUND\",\n              \"message\": \"Dataset not found for the tenantId: <tenantId>, userId: <userId>, datasetName: <datasetName>\"\n          }\n\n

500:

Request could not be written to the database, possibly due to db conflict. Retrying may fix the issue.

            {\n                \"statusCode\": \"ERROR\",\n                \"message\": \"<deleteType> request could not be queued - errorCode: <dbErrorCode>\"\n            }\n\n

Request was enqueued earlier and failed with an error

            {\n                \"statusCode\": \"ERROR\",\n                \"message\": \"dataset delete request to <deleteType> the dataset has had an error.\"\n            }\n\n

An unexpected error has occurred.

            {\n                \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n                \"message\": \"Internal Server Error, please try again later.\"\n            }\n\n

Request has already been enqueued for the deleteType

            {\n                \"statusCode\": \"REQUEST_ALREADY_ENQUEUED\",\n                \"message\": \"The request to <deleteType> has already been enqueued in the system.\"\n            }\n\n

Request is not allowed at this time since a deleteType request is already in progress.

            {\n                \"statusCode\": \"CONCURRENT_REQUEST_IN_PROGRESS\",\n                \"message\": \"The system is currently working on a different <UPDATE_DATA_TASK_CODE_JAR/UPDATE_DATA_TASK_CODE_ECR_IMAGE> request. Check to see if the request is a duplicate of the existing request. enqueuedRequest: <enqueuedRequest>, requested: <requested>\"\n            }\n\n

Request is not allowed at this time since a concurrent update request is in progress (for example, update code, update compute configuration, redriving etc)

            {\n                \"statusCode\": \"CONCURRENT_REQUEST_IN_PROGRESS\",\n                \"message\": \"A concurrent request is being processed by the system. enqueuedRequest: <enqueuedRequest>\"\n            }\n\n

Request is not allowed at this time since the current datasetStatus does not allow Update Dataset Code requests. Update Dataset Code requests are only allowed when datasetStatus is ERRORED.

          {\n              \"statusCode\": \"NOT_ALLOWED_AT_THIS_TIME\",\n              \"message\": \"Dataset is currently in <datasetStatus> state. <deleteType> is not allowed in this state.\"\n          }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
\n

Docs

You can learn about Datasets and their lifecycle at: https://www.letsdata.io/docs#datasets
You can learn about S3 Read Connector at: https://www.letsdata.io/docs#readconnectors3
You can learn about SDK Interfaces at: https://www.letsdata.io/docs#sdkinterface
You can learn about Access Grants at: https://www.letsdata.io/docs#accessgrants

\n","urlObject":{"path":["api","dataset","code"],"host":["https://www.letsdata.io"],"query":[],"variable":[]}},"response":[{"id":"a7d42244-9959-448c-bfb3-03613e42542c","name":"Example - Update Dataset Code","originalRequest":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"body":{"mode":"raw","raw":" {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"APICreateDatasetExample1\",\n \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n \"interfaceECRImageResourceLocation\": \"Customer\"\n }","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/dataset/code"},"status":"Internal Server Error","code":500,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:27:58 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"154"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"4ff02a03-a41d-4cfd-be02-668bf4c5da19"},{"key":"x-amz-apigw-id","value":"UbioREakoAMEbfg="},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee17ce-16a51dc86cf84a96337d8afe"}],"cookie":[],"responseTime":null,"body":"{\n \"statusCode\": \"NOT_ALLOWED_AT_THIS_TIME\",\n \"message\": \"Dataset is currently in DELETED state. UPDATE_DATA_TASK_CODE_ECR_IMAGE is not allowed in this state.\"\n}"}],"_postman_id":"35c39171-ce73-411e-8731-1ef9f6bcba07"},{"name":"View Status of Dataset Code Update Request","id":"4a7bb028-ef46-4e3b-9221-21edbf4cde4d","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/dataset/code?tenantId=tenantId&userId=userId&datasetName=CommonCrawlReworked196&requestId=9d78de233dc4f97c75e19adcbbfdded3","description":"

dataset/code GET

View the progress of a dataset's code update workflow by issuing a GET on the dataset/code resource.

Input Parameters:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For Example, 078260ed-3124-4de0-8eee-cc5b5025e7ad (TODO - this can be optional, API gets it from token)
datasetName: The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022
requestId: The requestId of the Update Dataset Code request. This is returned as updateDatasetCodeRequest.requestId when an Update Dataset Code request is created (dataset/code POST call).

Example

# view update dataset code JAR workflow\napi/dataset/code?tenantId=d5feaf90-71a9-41ee-b1b9-35e4242c3155&userId=accb3567-2b6e-41ae-b00d-6ce1f9a58d94&datasetName=CommonCrawlReworked196&requestId=9d78de233dc4f97c75e19adcbbfdded3\n# view update dataset code ECR Image workflow\napi/dataset/code?tenantId=d5feaf90-71a9-41ee-b1b9-35e4242c3155&userId=accb3567-2b6e-41ae-b00d-6ce1f9a58d94&datasetName=TargetUriExtractorDatasetPython4&requestId=sha256:84ecce97aced938eca7f2a9dda30358bb3a3ae7e90a2efea143e582097517f88\n\n

Output Parameters:

The HttpStatusCode of the response can be looked at to determine success / error. The response body is JSON that has details about the dataset, the updateDatasetCodeRequest status and the updateDatasetCodeWorkflow steps. The updateDatasetCodeWorkflow differs between the JAR and the ECR Image updates. The response body JSON is as follows:

Update Dataset Code JAR response: The Update Dataset Code JAR response has the following elements.

    {\n        \"updateDatasetCodeWorkflow\": {\n            \"Initialize Update Dataset Code Request\": {\n                \"startDatetime\": 1702123914195,\n                \"task\": \"Initialize Update Dataset Code Request\",\n                \"endDatetime\": 1702123914213,\n                \"status\": \"COMPLETE\"\n            },\n            \"Implementation Jar S3 Artifact - Create Internal Copy\": {},\n            \"Create Dataset Code Builds\": {},\n            \"Complete Dataset Code Builds\": {},\n            \"Update Dataset Artifact Links in Database\": {},\n            \"Update Data Task Lambda Function Code\": {},\n            \"Finalize Update Dataset Code Request\": {},\n            \"Complete Update Dataset Code Request\": {}\n        },\n        \"updateDatasetCodeRequest\": {\n            \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n            \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n            \"datasetName\": \"CommonCrawlReworked196\",\n            \"datasetId\": \"9a4c66ef759622e7495e66a45044d015\",\n            \"requestType\": \"UPDATE_DATA_TASK_CODE_JAR\",\n            \"requestId\": \"8cddc559c2cd5b5762a2c8f4d28cd6b6\",\n            \"requestStatus\": \"PROCESSING\",\n            \"createDatetime\": 1691621844993,\n            \"updateDatetime\": 1691621860271,\n            \"artifactFileS3Link\": \"s3://resonancecommoncrawl-jar/letsdata-common-crawl-1.0-SNAPSHOT-jar-with-dependencies.jar\",\n            \"artifactFileS3LinkAccessGrantedRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n            \"artifactFileAccessGrantedRoleExternalId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n            \"artifactFileS3LinkResourceLocation\": \"Customer\"\n        },\n        \"dataset\":\n        {\n            \"tenantId\": \"String\",\n            \"userId\": \"String\",\n            \"datasetName\": \"String\",\n            \"region\": \"String\",\n            \"accessGrantRoleArn\": \"String\",\n            \"customerAccountForAccess\": \"String\",\n            \"readConnector\": {\n                ...\n            },\n            \"writeConnector\": {\n                ...\n            },\n            \"errorConnector\": {\n                ...\n            },\n            \"computeEngine\": {\n                ...\n            },\n            \"manifestFile\": {\n                ...\n            }\n        }\n    }\n\n

Update Dataset Code ECR response: The Update Dataset Code ECR Image response has the following elements.

  {\n  \"updateDatasetCodeWorkflow\": {\n      \"Initialize Update Dataset Code Request\": {\n          \"startDatetime\": 1702123914195,\n          \"task\": \"Initialize Update Dataset Code Request\",\n          \"endDatetime\": 1702123914213,\n          \"status\": \"COMPLETE\"\n      },\n      \"Update Dataset Artifact Links in Database\": {\n          \"startDatetime\": 1702123914753,\n          \"task\": \"Update Dataset Artifact Links in Database\",\n          \"endDatetime\": 1702123914766,\n          \"status\": \"COMPLETE\"\n      },\n      \"Update Data Task Lambda Function Code\": {\n          \"startDatetime\": 1702124601645,\n          \"task\": \"Update Data Task Lambda Function Code\",\n          \"endDatetime\": 1702124602831,\n          \"status\": \"COMPLETE\"\n      },\n      \"Finalize Update Dataset Code Request\": {\n          \"startDatetime\": 1702124940986,\n          \"task\": \"Finalize Update Dataset Code Request\",\n          \"endDatetime\": 1702124941000,\n          \"status\": \"COMPLETE\"\n      },\n      \"Complete Update Dataset Code Request\": {\n          \"startDatetime\": 1702124941111,\n          \"task\": \"Complete Update Dataset Code Request\",\n          \"endDatetime\": 1702124941125,\n          \"status\": \"COMPLETE\"\n      }\n  },\n  \"updateDatasetCodeRequest\": {\n      \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n      \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n      \"datasetName\": \"TargetUriExtractorDatasetPython4\",\n      \"datasetId\": \"c106bb4d246b5244fcef229ecba4c12d\",\n      \"requestType\": \"UPDATE_DATA_TASK_CODE_ECR_IMAGE\",\n      \"requestId\": \"sha256:84ecce97aced938eca7f2a9dda30358bb3a3ae7e90a2efea143e582097517f88\",\n      \"requestStatus\": \"COMPLETE\",\n      \"createDatetime\": 1702123898946,\n      \"updateDatetime\": 1702124940987,\n      \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n      \"interfaceECRImageResourceLocation\": \"Customer\",\n      \"artifactFileS3LinkAccessGrantedRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n      \"artifactFileAccessGrantedRoleExternalId\": null\n  },\n  \"dataset\": {\n      \"tenantId\": \"String\",\n      \"userId\": \"String\",\n      \"datasetName\": \"String\",\n      \"region\": \"String\",\n      \"accessGrantRoleArn\": \"String\",\n      \"customerAccountForAccess\": \"String\",\n      \"readConnector\": {\n          ...\n      },\n      \"writeConnector\": {\n          ...\n      },\n      \"errorConnector\": {\n          ...\n      },\n      \"computeEngine\": {\n          ...\n      },\n      \"manifestFile\": {\n          ...\n      }\n  }\n  }\n\n

updateDatasetCodeWorkflow: These are the status of the individual steps of the update dataset code workflow.
\n
dataset: This is the dataset json document that has details about the read, write and error connectors, the manifest file, the compute engine, access grants and system's internal details about the datasetStatus, progress and execution logs. datasetStatus should tell you the latest state the dataset is in. Details at: https://www.letsdata.io/docs#datasets
\n
updateDatasetCodeRequest: The status of the updateDatasetCodeRequest. updateDatasetCodeRequest.requestStatus should inform you about the current status of the delete request (CREATED, PROCESSING, COMPLETE, ERROR). The remaining attributes are echo of the request parameters.
\n

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

Request successfully retrieved the update dataset code request status for the dataset. The response body has the requestStatus, dataset details and the update workflow.

      {\n          \"updateDatasetCodeWorkflow\": {\n              ...\n          },\n          \"updateDatasetCodeRequest\": {\n              ...\n          },\n          \"dataset\": {\n              ...\n          }\n       }\n\n

404:
\n
- The dataset for the tenantId, userId and datasetName was not found in the database. An empty requestStatus, dataset and update workflow is returned in the response JSON.
  \n
```
      {\n        \"updateDatasetCodeWorkflow\": { },\n        \"updateDatasetCodeRequest\": { },\n        \"dataset\": { }\n      }\n\n
```
  \n
- The dataset exists but the update dataset code request does not exist in the database. In this case, dataset details are returned with an empty requestStatus and workflow JSON.
  \n
```
      {\n        \"updateDatasetCodeWorkflow\": { },\n        \"updateDatasetCodeRequest\": { },\n        \"dataset\":\n        {\n            ...\n        }\n      }\n\n
```
  \n
\n
500:
\n
- An unexpected error has occurred.
  \n
```
      {\n      \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n      \"message\": \"Internal Server Error, please try again later.\"\n      }\n\n
```
  \n
- In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
  \n
\n

Docs:

You can learn about Datasets and their lifecycle at: https://www.letsdata.io/docs#datasets
You can learn about S3 Read Connector at: https://www.letsdata.io/docs#readconnectors3
You can learn about SDK Interfaces at: https://www.letsdata.io/docs#sdkinterface
You can learn about Access Grants at: https://www.letsdata.io/docs#accessgrants

\n","urlObject":{"path":["api","dataset","code"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

\n","type":"text/plain"},"key":"userId","value":"userId"},{"description":{"content":"

The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022

\n","type":"text/plain"},"key":"datasetName","value":"CommonCrawlReworked196"},{"description":{"content":"

The requestId of the Update Dataset Code request.

\n","type":"text/plain"},"key":"requestId","value":"9d78de233dc4f97c75e19adcbbfdded3"}],"variable":[]}},"response":[{"id":"90e8c662-e39f-495b-9599-36911e357329","name":"Example - View Status of Dataset Code Update Request","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/dataset/code?tenantId=tenantId&userId=userId&datasetName=CommonCrawlReworked196&requestId=9d78de233dc4f97c75e19adcbbfdded3","host":["https://www.letsdata.io"],"path":["api","dataset","code"],"query":[{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)"},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner."},{"key":"datasetName","value":"CommonCrawlReworked196","description":"The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022"},{"key":"requestId","value":"9d78de233dc4f97c75e19adcbbfdded3","description":"The requestId of the Update Dataset Code request."}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:24:45 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"3834"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"234d01ff-4f27-4918-be84-b5250ce2477a"},{"key":"x-amz-apigw-id","value":"UbiJEEOcIAMEvtQ="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee1706-3eccdd943094800337c683e9"}],"cookie":[],"responseTime":null,"body":"{\n \"updateDatasetCodeRequest\": {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlReworked196\",\n \"datasetId\": \"9a4c66ef759622e7495e66a45044d015\",\n \"requestType\": \"UPDATE_DATA_TASK_CODE_JAR\",\n \"requestId\": \"9d78de233dc4f97c75e19adcbbfdded3\",\n \"requestStatus\": \"COMPLETE\",\n \"createDatetime\": 1691510057698,\n \"updateDatetime\": 1691510243756,\n \"artifactFileS3Link\": \"s3://resonancecommoncrawl-jar/letsdata-common-crawl-1.0-SNAPSHOT-jar-with-dependencies.jar\",\n \"artifactFileS3LinkAccessGrantedRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"artifactFileAccessGrantedRoleExternalId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"artifactFileS3LinkResourceLocation\": \"Customer\"\n },\n \"updateDatasetCodeWorkflow\": {\n \"Initialize Update Dataset Code Request\": {},\n \"Implementation Jar S3 Artifact - Create Internal Copy\": {},\n \"Create Dataset Code Builds\": {},\n \"Complete Dataset Code Builds\": {},\n \"Update Dataset Artifact Links in Database\": {},\n \"Update Data Task Lambda Function Code\": {},\n \"Finalize Update Dataset Code Request\": {},\n \"Complete Update Dataset Code Request\": {}\n },\n \"dataset\": {\n \"datasetName\": \"CommonCrawlReworked196\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"customerAccessRoleArn\": \"arn:aws:iam::223413462631:role/TestCustomerAccess9a4c66ef759622e7495e66a45044d015IAMRole\",\n \"readConnector\": {\n \"readerType\": \"KINESISSTREAMREADER\",\n \"artifactFileS3Link\": \"s3://resonancecommoncrawl-jar/letsdata-common-crawl-1.0-SNAPSHOT-jar-with-dependencies.jar\",\n \"streamArn\": \"arn:aws:kinesis:us-east-1:223413462631:stream/tldwcdc82df4e431f3091f2ff36f4ed97cef7\",\n \"throwOnMessageReadFail\": false,\n \"connectorDestination\": \"KINESIS\",\n \"artifactImplementationLanguage\": \"JAVA\",\n \"streamResourceLocation\": \"LetsData\",\n \"artifactFileS3LinkResourceLocation\": \"Customer\",\n \"region\": \"us-east-1\",\n \"streamReaderClassName\": \"com.letsdata.commoncrawl.interfaces.implementations.kinesisstreamreader.CommonCrawlStreamReader\"\n },\n \"writeConnector\": {\n \"isDynamoDBJson\": false,\n \"throwOnItemExists\": false,\n \"dynamoDBTableName\": \"tldwc9a4c66ef759622e7495e66a45044d015\",\n \"connectorDestination\": \"DYNAMODB\",\n \"dynamoDBPartitionKey\": {\n \"attributeName\": \"url\",\n \"keyType\": \"HASH\"\n },\n \"overwriteItems\": false,\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\",\n \"dynamoDBWriteCapacityUnits\": 30,\n \"dynamoDBReadCapacityUnits\": 5\n },\n \"errorConnector\": {\n \"bucketName\": \"tldec9a4c66ef759622e7495e66a45044d015\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA\",\n \"memoryLimitInMegabytes\": 5120,\n \"concurrency\": 5,\n \"timeoutInSeconds\": 300\n },\n \"manifestFile\": {\n \"readerType\": \"KINESISSTREAMREADER\",\n \"readerTaskStartFromCondition\": \"Earliest\",\n \"manifestType\": \"KinesisStreamReaderManifest\",\n \"readerTaskStopCondition\": \"StopWhenNoData\",\n \"region\": \"us-east-1\",\n \"readerTaskStopAfterConsecutiveEmptyReceives\": 30\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"9a4c66ef759622e7495e66a45044d015\",\n \"datasetStatus\": \"DELETED\",\n \"datasetProgress\": {\n \"totalTasks\": 1,\n \"completedTasks\": 0,\n \"errorTasks\": 1\n },\n \"executionLogs\": [\n {\n \"startDatetime\": 1691498514467,\n \"endDatetime\": 1691503967132\n },\n {\n \"startDatetime\": 1691507843450,\n \"endDatetime\": 1691507863026\n },\n {\n \"startDatetime\": 1691507935508,\n \"endDatetime\": 1691507943887\n },\n {\n \"startDatetime\": 1691508076917,\n \"endDatetime\": 1691508077672\n },\n {\n \"startDatetime\": 1691509082485,\n \"endDatetime\": 1691509102583\n },\n {\n \"startDatetime\": 1691511242131,\n \"endDatetime\": 1691511264715\n },\n {\n \"startDatetime\": 1691517557600,\n \"endDatetime\": 1691517578179\n },\n {\n \"startDatetime\": 1691518086279,\n \"endDatetime\": 1691518712556\n },\n {\n \"startDatetime\": 1691522159800,\n \"endDatetime\": 1691522223367\n },\n {\n \"startDatetime\": 1691523068573,\n \"endDatetime\": 1691523094327\n }\n ],\n \"createDatetime\": 1691496895387,\n \"updateDatetime\": 1695149622943\n }\n}"}],"_postman_id":"4a7bb028-ef46-4e3b-9221-21edbf4cde4d"}],"id":"b010823c-faf7-4baa-9c63-8a7393d9dbe4","description":"

The code sub resource for dataset. The sub resource has api to manage a dataset's code artifacts.

\n","_postman_id":"b010823c-faf7-4baa-9c63-8a7393d9dbe4"},{"name":"compute","item":[{"name":"View Status of Update Dataset Compute Request","id":"f5735933-6878-472c-9848-2b54389c41ed","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/dataset/compute?tenantId=tenantId&userId=userId&datasetName=TargetUriExtractorDatasetPython4&requestId=d505e97aa941c2ceadb49d2a120738e2","description":"

dataset/compute GET

View the progress of a dataset's compute update workflow by issuing a GET on the dataset/compute resource.

Input Parameters:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For Example, 078260ed-3124-4de0-8eee-cc5b5025e7ad (TODO - this can be optional, API gets it from token)
datasetName: The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022
requestId: The requestId of the Update Dataset Compute request. This is returned as updateDatasetComputeRequest.requestId when an Update Dataset Compute request is created (dataset/compute POST call).

Example

api/dataset/compute?tenantId=d5feaf90-71a9-41ee-b1b9-35e4242c3155&userId=accb3567-2b6e-41ae-b00d-6ce1f9a58d94&datasetName=CommonCrawlReworked196&requestId=9d78de233dc4f97c75e19adcbbfdded3\n\n

Output Parameters:

The HttpStatusCode of the response can be looked at to determine success / error. The response body is JSON that has details about the dataset, the updateDatasetComputeRequest status and the updateDatasetComputeWorkflow steps. The updateDatasetComputeWorkflow differs between the JAR and the ECR Image updates. The response body JSON is as follows:

Update Dataset Code JAR response: The Update Dataset Code JAR response has the following elements.

    {\n        \"updateDatasetComputeRequest\": {\n            \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n            \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n            \"datasetName\": \"TargetUriExtractorDatasetPython4\",\n            \"datasetId\": \"c106bb4d246b5244fcef229ecba4c12d\",\n            \"requestType\": \"UPDATE_COMPUTE_ENGINE\",\n            \"requestId\": \"d505e97aa941c2ceadb49d2a120738e2\",\n            \"requestStatus\": \"COMPLETE\",\n            \"createDatetime\": 1702126414576,\n            \"updateDatetime\": 1702126429959,\n            \"computeEngineType\": \"LAMBDA\",\n            \"concurrency\": 5\n        },\n        \"updateDatasetComputeWorkflow\": {\n            \"Initialize Update Dataset Code Request\": {\n                \"startDatetime\": 1702126428670,\n                \"task\": \"Initialize Update Dataset Code Request\",\n                \"endDatetime\": 1702126428693,\n                \"status\": \"COMPLETE\"\n            },\n            \"Update Data Task Lambda Function Concurrency\": {\n                \"startDatetime\": 1702126429193,\n                \"task\": \"Update Data Task Lambda Function Concurrency\",\n                \"endDatetime\": 1702126429605,\n                \"status\": \"COMPLETE\"\n            },\n            \"Update Data Task Lambda Function Memory\": {\n                \"startDatetime\": 1702126429687,\n                \"task\": \"Update Data Task Lambda Function Memory\",\n                \"endDatetime\": 1702126429690,\n                \"status\": \"COMPLETE\"\n            },\n            \"Update Data Task Lambda Function Timeout\": {\n                \"startDatetime\": 1702126429753,\n                \"task\": \"Update Data Task Lambda Function Timeout\",\n                \"endDatetime\": 1702126429754,\n                \"status\": \"COMPLETE\"\n            },\n            \"Update Data Task Lambda Function Log Level\": {\n                \"startDatetime\": 1702126429827,\n                \"task\": \"Update Data Task Lambda Function Log Level\",\n                \"endDatetime\": 1702126429828,\n                \"status\": \"COMPLETE\"\n            },\n            \"Update Dataset's Compute Engine in Database\": {\n                \"startDatetime\": 1702126429877,\n                \"task\": \"Update Dataset's Compute Engine in Database\",\n                \"endDatetime\": 1702126429889,\n                \"status\": \"COMPLETE\"\n            },\n            \"Finalize Update Dataset Code Request\": {\n                \"startDatetime\": 1702126429959,\n                \"task\": \"Finalize Update Dataset Code Request\",\n                \"endDatetime\": 1702126429968,\n                \"status\": \"COMPLETE\"\n            },\n            \"Complete Update Dataset Code Request\": {\n                \"startDatetime\": 1702126430019,\n                \"task\": \"Complete Update Dataset Code Request\",\n                \"endDatetime\": 1702126430031,\n                \"status\": \"COMPLETE\"\n            }\n        },\n        \"dataset\":\n        {\n            \"tenantId\": \"String\",\n            \"userId\": \"String\",\n            \"datasetName\": \"String\",\n            \"region\": \"String\",\n            \"accessGrantRoleArn\": \"String\",\n            \"customerAccountForAccess\": \"String\",\n            \"readConnector\": {\n                ...\n            },\n            \"writeConnector\": {\n                ...\n            },\n            \"errorConnector\": {\n                ...\n            },\n            \"computeEngine\": {\n                ...\n            },\n            \"manifestFile\": {\n                ...\n            }\n        }\n    }\n\n

updateDatasetComputeWorkflow: These are the status of the individual steps of the update dataset compute workflow.
updateDatasetComputeRequest: The status of the updateDatasetComputeRequest. updateDatasetComputeRequest.requestStatus should inform you about the current status of the update dataset compute request (CREATED, PROCESSING, COMPLETE, ERROR). The remaining attributes are echo of the request parameters.
dataset: This is the dataset json document that has details about the read, write and error connectors, the manifest file, the compute engine, access grants and system's internal details about the datasetStatus, progress and execution logs. datasetStatus should tell you the latest state the dataset is in. Details at: https://www.letsdata.io/docs#datasets

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

Request successfully retrieved the update dataset compute request status for the dataset. The response body has the requestStatus, dataset details and the update workflow.

    {\n        \"updateDatasetComputeWorkflow\": {\n            ...\n        },\n        \"updateDatasetComputeRequest\": {\n            ...\n        },\n        \"dataset\": {\n            ...\n        }\n     }\n\n

404:
\n
- The dataset for the tenantId, userId and datasetName was not found in the database. An empty requestStatus, dataset and update workflow is returned in the response JSON.
  \n
```
    {\n      \"updateDatasetComputeWorkflow\": { },\n      \"updateDatasetComputeRequest\": { },\n      \"dataset\": { }\n    }\n\n
```
  \n
- The dataset exists but the update dataset compute request does not exist in the database. In this case, dataset details are returned with an empty requestStatus and workflow JSON.
  \n
```
    {\n      \"updateDatasetComputeWorkflow\": { },\n      \"updateDatasetComputeRequest\": { },\n      \"dataset\":\n      {\n          ...\n      }\n    }\n\n
```
  \n
\n
500:
\n
- An unexpected error has occurred.
  \n
```
    {\n    \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n    \"message\": \"Internal Server Error, please try again later.\"\n    }\n\n
```
  \n
- In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
  \n
\n

Docs:

You can learn about Lambda Compute Engine: https://www.letsdata.io/docs#computeenginelambda

\n","urlObject":{"path":["api","dataset","compute"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

\n","type":"text/plain"},"key":"userId","value":"userId"},{"description":{"content":"

The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022

\n","type":"text/plain"},"key":"datasetName","value":"TargetUriExtractorDatasetPython4"},{"description":{"content":"

The requestId of the Update Dataset Compute request.

\n","type":"text/plain"},"key":"requestId","value":"d505e97aa941c2ceadb49d2a120738e2"}],"variable":[]}},"response":[{"id":"7f5b6411-bd51-4c06-8f74-4f2c269107e1","name":"Example - View Status of Update Dataset Compute Request","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/dataset/compute?tenantId=tenantId&userId=userId&datasetName=TargetUriExtractorDatasetPython4&requestId=d505e97aa941c2ceadb49d2a120738e2","host":["https://www.letsdata.io"],"path":["api","dataset","compute"],"query":[{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner."},{"key":"datasetName","value":"TargetUriExtractorDatasetPython4","description":"The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022"},{"key":"requestId","value":"d505e97aa941c2ceadb49d2a120738e2","description":"The requestId of the Update Dataset Compute request."}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:28:32 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"3657"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"59c1fe7a-03e8-4b57-8615-a85412b9fc0a"},{"key":"x-amz-apigw-id","value":"UbisqGY_oAMEnew="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee17ea-2c750f1c56e2c16b463e2ee2"}],"cookie":[],"responseTime":null,"body":"{\n \"updateDatasetComputeRequest\": {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"TargetUriExtractorDatasetPython4\",\n \"datasetId\": \"c106bb4d246b5244fcef229ecba4c12d\",\n \"requestType\": \"UPDATE_COMPUTE_ENGINE\",\n \"requestId\": \"d505e97aa941c2ceadb49d2a120738e2\",\n \"requestStatus\": \"COMPLETE\",\n \"createDatetime\": 1702126414576,\n \"updateDatetime\": 1702126429959,\n \"computeEngineType\": \"LAMBDA\",\n \"concurrency\": 5\n },\n \"updateDatasetComputeWorkflow\": {\n \"Initialize Update Dataset Code Request\": {\n \"startDatetime\": 1702126428670,\n \"task\": \"Initialize Update Dataset Code Request\",\n \"endDatetime\": 1702126428693,\n \"status\": \"COMPLETE\"\n },\n \"Update Data Task Lambda Function Concurrency\": {\n \"startDatetime\": 1702126429193,\n \"task\": \"Update Data Task Lambda Function Concurrency\",\n \"endDatetime\": 1702126429605,\n \"status\": \"COMPLETE\"\n },\n \"Update Data Task Lambda Function Memory\": {\n \"startDatetime\": 1702126429687,\n \"task\": \"Update Data Task Lambda Function Memory\",\n \"endDatetime\": 1702126429690,\n \"status\": \"COMPLETE\"\n },\n \"Update Data Task Lambda Function Timeout\": {\n \"startDatetime\": 1702126429753,\n \"task\": \"Update Data Task Lambda Function Timeout\",\n \"endDatetime\": 1702126429754,\n \"status\": \"COMPLETE\"\n },\n \"Update Data Task Lambda Function Log Level\": {\n \"startDatetime\": 1702126429827,\n \"task\": \"Update Data Task Lambda Function Log Level\",\n \"endDatetime\": 1702126429828,\n \"status\": \"COMPLETE\"\n },\n \"Update Dataset's Compute Engine in Database\": {\n \"startDatetime\": 1702126429877,\n \"task\": \"Update Dataset's Compute Engine in Database\",\n \"endDatetime\": 1702126429889,\n \"status\": \"COMPLETE\"\n },\n \"Finalize Update Dataset Code Request\": {\n \"startDatetime\": 1702126429959,\n \"task\": \"Finalize Update Dataset Code Request\",\n \"endDatetime\": 1702126429968,\n \"status\": \"COMPLETE\"\n },\n \"Complete Update Dataset Code Request\": {\n \"startDatetime\": 1702126430019,\n \"task\": \"Complete Update Dataset Code Request\",\n \"endDatetime\": 1702126430031,\n \"status\": \"COMPLETE\"\n }\n },\n \"dataset\": {\n \"datasetName\": \"TargetUriExtractorDatasetPython4\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"customerAccessRoleArn\": \"arn:aws:iam::223413462631:role/TestCustomerAccessc106bb4d246b5244fcef229ecba4c12dIAMRole\",\n \"readConnector\": {\n \"readerType\": \"SINGLEFILEREADER\",\n \"bucketName\": \"commoncrawl\",\n \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n \"connectorDestination\": \"S3\",\n \"interfaceECRImageResourceLocation\": \"Customer\",\n \"artifactImplementationLanguage\": \"PYTHON\",\n \"region\": \"us-east-1\",\n \"bucketResourceLocation\": \"Customer\"\n },\n \"writeConnector\": {\n \"connectorDestination\": \"KINESIS\",\n \"kinesisShardCount\": 1,\n \"kinesisStreamName\": \"tldwcc106bb4d246b5244fcef229ecba4c12d\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"errorConnector\": {\n \"bucketName\": \"tldecc106bb4d246b5244fcef229ecba4c12d\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA\",\n \"memoryLimitInMegabytes\": 5120,\n \"concurrency\": 5,\n \"timeoutInSeconds\": 300\n },\n \"manifestFile\": {\n \"readerType\": \"SINGLEFILEREADER\",\n \"manifestType\": \"S3ReaderTextManifestFile\",\n \"region\": \"us-east-1\",\n \"fileContents\": \"crawl-data/CC-MAIN-2022-21/segments/1652662509990.19/wet/CC-MAIN-20220516041337-20220516071337-00000.warc.wet.gz\"\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"c106bb4d246b5244fcef229ecba4c12d\",\n \"datasetStatus\": \"DELETED\",\n \"datasetProgress\": {\n \"totalTasks\": 1,\n \"completedTasks\": 0,\n \"errorTasks\": 1\n },\n \"executionLogs\": [\n {\n \"startDatetime\": 1702121395478,\n \"endDatetime\": 1702121510653\n }\n ],\n \"createDatetime\": 1702121180320,\n \"updateDatetime\": 1702127240742,\n \"deleteDatetime\": 1702127240742\n }\n}"}],"_postman_id":"f5735933-6878-472c-9848-2b54389c41ed"},{"name":"Update Dataset Compute","id":"29cc38e6-906a-4f12-98ad-bdecf69a5e97","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"body":{"mode":"raw","raw":" {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"IndexWebCrawlDataDec2022\",\n \"computeEngineType\": \"LAMBDA\",\n \"concurrency\": 10,\n \"logLevel\": \"ERROR\"\n }","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/dataset/code","description":"

datasets/compute POST

Update the Lambda compute engine parameters such as concurrency, memoryLimitInMegaBytes, timeoutInSeconds and logLevel for a dataset. A dataset needs to be in ERRORED status for the lambda compute engine parameter updates. You must specify at least 1 parameter in the JSON request for the compute engine update. This does kick off a Update Dataset Compute workflow which will update the Data Task Lambda function. You can view the progress of a update dataset compute engine workflow by issuing a GET on the dataset/code resource (see its docs for details).

Input Parameters:

The POST body for a JSON request has the following schema:

{\n    \"tenantId\": \"the dataset's tenantId\",\n    \"userId\": \"the dataset's userId\",\n    \"datasetName\": \"the datasetName\",\n    \"computeEngineType\": \"the computeEngineType. Allowed values [LAMBDA]\", // TODO: LAMBDA_AND_SAGEMAKER, LAMBDA_AND_SPARK\n    \"concurrency\": Integer - the dataset's Data Task Lambda function's concurrency,\n    \"memoryLimitInMegaBytes\": Integer - The dataset's Data Task Lambda function's memory limit in MB. Min allowed value: 512, Max Allowed Value: 10240,\n    \"timeoutInSeconds\": Integer - the dataset's Data Task Lambda function's timeout in seconds. Min allowed value: 5, Max Allowed Value: 900,\n    \"logLevel\": \"the dataset's Data Task Lambda function's Log Level. Allowed Values: [DEBUG, INFO, WARN, ERROR]\"\n}\n\n

Here are the details for the JSON request schema:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For Example, --userId 078260ed-3124-4de0-8eee-cc5b5025e7ad (TODO - this can be optional, API gets it from token)
datasetName: The dataset name for the dataset that the user wants to run the command for.
computeEngineType: The Compute Engine Type that is being updated. Currently only LAMBDA is supported as the compute engine
concurrency: Integer - The dataset's Data Task Lambda function's concurrency
memoryLimitInMegaBytes: Integer - The dataset's Data Task Lambda function's memory limit in MB. Min allowed value: 512, Max Allowed Value: 10240
timeoutInSeconds: Integer - The dataset's Data Task Lambda function's timeout in seconds. Min allowed value: 5, Max Allowed Value: 900
logLevel: The dataset's Data Task Lambda function's Log Level. Allowed Values: [DEBUG, INFO, WARN, ERROR]

Examples:

For example, a POST request to the dataset/compute resource with the following body would update the compute for the dataset named IndexWebCrawlDataDec2022 belonging to the tenant (tenantId: d5feaf90-71a9-41ee-b1b9-35e4242c3155) and user (userId: accb3567-2b6e-41ae-b00d-6ce1f9a58d94) and set the Data Task Lambda Function concurrency to 10 and logLevel to ERROR.
\n
```
  {\n    \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n    \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n    \"datasetName\": \"IndexWebCrawlDataDec2022\",\n    \"computeEngineType\": \"LAMBDA\",\n    \"concurrency\": 10,\n    \"logLevel\": \"ERROR\"\n  }\n\n
```
\n
Output Parameters:
\n

The HttpStatusCode of the response can be looked at to determine success / error. The response body is JSON that has the status of the update request. The response body JSON has the following schema:\n\n

{\n    \"statusCode\": \"<SUCCESS|ERROR>\",\n    \"message\": \"String\"\n    \"updateDatasetComputeRequest\" :{\n            \"tenantId\": \"String\",\n            \"userId\": \"String\",\n            \"datasetName\": \"String\",\n            \"datasetId\": \"String\",\n            \"requestType\": \"String\",\n            \"requestId\": \"String\",\n            \"requestStatus\": \"String\",\n            \"createDatetime\": \"Long\",\n            \"updateDatetime\": \"Long\",\n            \"computeEngineType\": \"String\",\n            \"concurrency\": \"Long\",\n            \"memoryLimitInMegaBytes\": \"Long\",\n            \"timeoutInSeconds\": \"Long\",\n            \"logLevel\": \"String\",\n    }\n}\n\n

statusCode: StatusCode of the request - this can be either SUCCESS or ERROR. In each of these cases, the Message string has additional details about the status.
message: The error / success message that has the details about the status of the request.
updateDatasetComputeRequest: For a success response, an updateDatasetComputeRequest map is returned which has the request details. The important properties in this request map are the requestStatus and the requestId. The requestId can be used to view the status of the update requests. The requestId is essentially the MD5 of the input parameters which can be used to de-duplicate update datsetset compute requests. The requestId can be used to view the status of the update requests by issuing a GET on the dataset/compute resource (see docs for details).

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

update compute request i.) has been successfully processed ii.) already been enqueued iii.) currently being processed iv.) completed with errors

  {\n    \"statusCode\": \"SUCCESS\",\n    \"message\": \"UpdateDatasetCompute request with requestId <requestId> has been successfully processed by the system.|\n              UpdateDatasetCompute request with requestId <requestId> has already been enqueued in the system.|\n              UpdateDatasetCompute request with requestId <requestId> is currently being processed by the system.|\n              UpdateDatasetCompute request with requestId <requestId> has completed with errors.\"\n    \"updateDatasetComputeRequest\":\n    {\n      ... // the update compute request in the database\n    }\n  }\n\n

Request was successfully enqueued

        {\n            \"statusCode\": \"SUCCESS\",\n            \"message\": \"<deleteType> request successfully enqueued.\"\n            \"updateDatasetComputeRequest\":\n            {\n              ... // the update compute request from the api call\n            }\n        }\n\n

404:

The dataset for the tenantId, userId and datasetName was not found in the database.

      {\n          \"statusCode\": \"NOT_FOUND\",\n          \"message\": \"Dataset not found for the tenantId: <tenantId>, userId: <userId>, datasetName: <datasetName>\"\n      }\n\n

500:

Invalid request that could not be deserialized. Check the request json and retry again.

        {\n            \"statusCode\": \"INVALID_REQUEST\",\n            \"message\": \"<exception error message>\"\n        }\n\n

An unexpected error has occurred.

        {\n            \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n            \"message\": \"Internal Server Error, please try again later.\"\n        }\n\n

Request has already been enqueued for the UPDATE_COMPUTE_ENGINE

        {\n            \"statusCode\": \"REQUEST_ALREADY_ENQUEUED\",\n            \"message\": \"The request to UPDATE_COMPUTE_ENGINE has already been enqueued in the system.\"\n        }\n\n

Request is not allowed at this time since a UPDATE_COMPUTE_ENGINE request is already in progress.

        {\n            \"statusCode\": \"CONCURRENT_REQUEST_IN_PROGRESS\",\n            \"message\": \"The system is currently working on a different UPDATE_COMPUTE_ENGINE request. Check to see if the request is a duplicate of the existing request. enqueuedRequest: <enqueuedRequest>, requested: <requested>\"\n        }\n\n

Request is not allowed at this time since a concurrent update request is in progress (for example, update code, update compute configuration, redriving etc)

        {\n            \"statusCode\": \"CONCURRENT_REQUEST_IN_PROGRESS\",\n            \"message\": \"A concurrent request is being processed by the system. enqueuedRequest: <enqueuedRequest>\"\n        }\n\n

Request is not allowed at this time since the current datasetStatus does not allow Update Dataset Compute requests. Update Dataset Compute requests are only allowed when datasetStatus is ERRORED.

      {\n          \"statusCode\": \"NOT_ALLOWED_AT_THIS_TIME\",\n          \"message\": \"Dataset is currently in <datasetStatus> state. UPDATE_COMPUTE_ENGINE is not allowed in this state.\"\n      }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
\n

Docs

You can learn about Lambda Compute Engine: https://www.letsdata.io/docs#computeenginelambda

\n","urlObject":{"path":["api","dataset","code"],"host":["https://www.letsdata.io"],"query":[],"variable":[]}},"response":[{"id":"3c690ca1-8793-42e3-a433-fbba7ae442e2","name":"Example - Update Dataset Compute","originalRequest":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"body":{"mode":"raw","raw":" {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"APICreateDatasetExample1\",\n \"computeEngineType\": \"LAMBDA\",\n \"concurrency\": 10,\n \"logLevel\": \"ERROR\"\n }","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/dataset/compute"},"status":"Internal Server Error","code":500,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:31:09 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"144"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"bb7e8b31-e00b-46fe-b85c-09f52b04b174"},{"key":"x-amz-apigw-id","value":"UbjGBEahIAMEixQ="},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee188c-1155d0a5607a9ef20479cd8b"}],"cookie":[],"responseTime":null,"body":"{\n \"statusCode\": \"NOT_ALLOWED_AT_THIS_TIME\",\n \"message\": \"Dataset is currently in DELETED state. UPDATE_COMPUTE_ENGINE is not allowed in this state.\"\n}"}],"_postman_id":"29cc38e6-906a-4f12-98ad-bdecf69a5e97"}],"id":"486d3239-a70e-4660-ae4d-a97ac1ee55d8","description":"

The compute sub resource of the dataset. This sub resource has api to maange the dataset's compute.

\n","_postman_id":"486d3239-a70e-4660-ae4d-a97ac1ee55d8"},{"name":"View Dataset","id":"3dcf94b7-b2ca-428d-ba8b-ea12daceeec1","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/dataset?tenantId=tenantId&userId=userId&datasetName=APICreateDatasetExample2","description":"

dataset GET

Details about any dataset in #Let's Data can be viewed by using the dataset GET API. The GET API shows the dataset configuration details json and the different dataset workflows that have been run. At a high level these are:

Dataset Configuration Details JSON: The dataset configuration details json has the different details about the dataset from dataset creation and also has high level updates about the dataset's status, execution logs and progress
Dataset Workflows: The view command also lists details about the different status transition workflows for the dataset. For example, an initialization workflow is executed when a dataset is created, a descale/freeze/delete/redrive workflow is executed when a dataset is descaled/frozen/deleted/redriven.

(Do note that the actual task execution, task logs, metrics and errors etc are separated into their own resources and you should look into those to understand each task's execution.)

Input Parameters:

datasetName: The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For Example, --userId 078260ed-3124-4de0-8eee-cc5b5025e7ad (TODO - this can be optional, API gets it from token)
tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)

Output Parameters:

The output is a JSON map that has the following sections:

{\n    \"dataset\": {\n    ...\n    },\n    \"initializationWorkflow\": {\n    ...\n    },\n    \"redriveWorkflows\": [\n    ...\n    ]\n}\n\n

dataset: This is the dataset json document that has details about the read, write and error connectors, the manifest file, the compute engine, access grants and system's internal details about the datasetStatus, progress and execution logs. Details at: https://www.letsdata.io/docs#datasets

#Let's Data defines a status for each Dataset which represents a dataset's status in the system. The status can have the following values:

CREATED: The dataset has been created by the user but the system has not started processing it yet.
INITIALIZING: The dataset has been picked up by the # Let's Data and the system is initializing the resources needed for the processing of the dataset.
PROCESSING: The dataset has been fully initialized and is now being processed by # Let's Data. This essentially means that the individual tasks defined in the manifest are now being executed by the system.
COMPLETED: The dataset processing has been completed and all tasks have successfully completed. There still may be individual errors archived by the tasks, but the task execution has completely parsed the file and sent error and write records to the error and write destinations.
ERRORED: The dataset processing has been completed and all tasks have completed but there is atleast 1 task that has errored i.e. The error task file has not been completely processed / exception during processing.
REDRIVING: This is a dataset status when user has submitted a request to REDRIVE the error tasks (after maybe fixing the errors). The system is preparing the resources for re-executing the error tasks.
DESCALED: This is when dataset has completed processing (success or error) and user / cost management service has decided to descale (different from reclaimed) the resources that were allocated for the dataset. For example, provisioned throughputs are decreased, lambda concurrency reclaimed etc. Though not supported yet, but dataset in this state can have its resources re-hydrated to rerun tasks etc if needed.
FROZEN: This is when the dataset has completed processing and the user / cost management service has decided to reclaim the resources that were allocated for the dataset. For example, internal queues are deleted, processing tables are deleted and any non user data infrastructure is reclaimed. Things such as user data in write destination and error destinations are still available though - this means that dataset consumers can continue processing from a frozen dataset. A frozen dataset cannot be re-hydrated.
DELETED: This is when the user has decided to delete the dataset - all resources are reclaimed. Zombie records are kept to disallow recreation and aid delayed processes such as billing etc.

It might be useful to look at the dataset's statuses and the dataset's lifecycle to understand how datasets transition between different states and the different workflows that are involved. Here is a quick look:

\n $\"Dataset%20Lifecycle\"$ \n\n

initializationWorkflow: The dataset when created goes through an initialization workflow where internal databases are setup, lambda functions are created, internal queues are initialized, tasks are scheduled and task monitoring is put in place. Users can view the progress of the initialization workflow by calling the view API. The initialization workflow is expected to list the following steps is a finite sequence of steps: https://www.letsdata.io/docs/datasets/#dataset-initialization-workflow
- Implementation Jar S3 Artifact - Create Internal Copy
- Write Connector - Create Kinesis Stream
- Error Connector - Create Error Bucket
- Create Internal Task Database
- Create Dataset Source Code Branch
- Create Dataset Code Config
- Create Dataset Code Build Project
- Create Dataset Code Builds
- Complete Dataset Code Builds
- Create Internal Queues
- Compute Engine - Create Data Task Lambda Function (1/4)
- Compute Engine - Create Data Task Lambda Function (2/4)
- Compute Engine - Create Data Task Lambda Function (3/4)
- Compute Engine - Create Data Task Lambda Function (4/4)
- Compute Engine - Task State Monitor Process (1/3)
- Compute Engine - Task State Monitor Process (2/3)
- Compute Engine - Task State Monitor Process (3/3)
- Grant Customer Account Access
- Create Tasks (1/2)
- Create Tasks (2/2)
- Finalize Initialization
\n

The workflow document is a map of the step name and the step's latest result. Steps that have not be started show up as empty maps. You may also see some steps in status ERROR and then on a later invocation show as COMPLETED, this is fine since the steps are retried until complete and we expect some transient timeout failures in waiting for resources to be initialized.

Here is an abbreviated example JSON initializationWorkflow:

{\n    \"Implementation Jar S3 Artifact - Create Internal Copy\": {\n        \"task\": \"Implementation Jar S3 Artifact - Create Internal Copy\",\n        \"status\": \"COMPLETED\",\n        \"startDatetime\":1671389022125,\n        \"endDatetime\": 1671389622842\n    },\n    \"Write Connector - Create Kinesis Stream\": {\n        \"task\": \"Write Connector - Create Kinesis Stream\",\n        \"status\": \"COMPLETED\",\n        \"startDatetime\":1671389682854,\n        \"endDatetime\": 1671389742457\n     },\n     \"Error Connector - Create Error Bucket\": {},\n     ...\n}\n\n

redriveWorkflows: When an ERRORED dataset is redriven, a redrive workflow is executed which is responsible for selecting and reinitializing failed tasks and applying the task redrive policy. Users can view all the redrive workflows for the dataset by calling this API. (There is also a dataset redrive view command that lists these workflows as well). You can learn more about error handling and task redrives in the docs: https://www.letsdata.io/docs/datasets/#dataset-redrive-workflow The redrive workflow is expected to list the following steps is a finite sequence of steps:
- Compute Redrive Task List
- Update Task State
- Finalize Redrive Request
\n

The workflow document is a list of redrive workflows where each workflow is a map of the workflow's step name and the step's latest result. Steps that have not be started show up as empty maps. You may also see some steps in status ERROR and then on a later invocation show as COMPLETED, this is fine since the steps are retried until complete and we expect some transient timeout failures in waiting for resources to be initialized.

Here is an abbreviated example JSON redriveWorkflow list:

[\n  {\n    \"Compute Redrive Task List\": {\n      \"task\": \"Compute Redrive Task List\",\n      \"status\": \"COMPLETED\",\n      \"startDatetime\": 1671389022125,\n      \"endDatetime\": 1671389622842\n    },\n    \"Update Task State\": {\n      \"task\": \"Update Task State\",\n      \"status\": \"COMPLETED\",\n      \"startDatetime\": 1671389682854,\n      \"endDatetime\": 1671389742457\n    },\n    \"Finalize Redrive Request\": {\n      ...\n    }\n  },\n  {\n    ...  \n  },\n  ...\n]\n\n

You can learn about Datasets at: https://82x9zh5ijl.execute-api.us-east-1.amazonaws.com/Test/docs#datasets

\n","urlObject":{"path":["api","dataset"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

\n","type":"text/plain"},"key":"userId","value":"userId"},{"description":{"content":"

The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022

\n","type":"text/plain"},"key":"datasetName","value":"APICreateDatasetExample2"}],"variable":[]}},"response":[{"id":"a0b64090-6190-4b09-86cb-72f7bbc58bd3","name":"Example - View Dataset","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/dataset?tenantId=tenantId&userId=userId&datasetName=APICreateDatasetExample1","host":["https://www.letsdata.io"],"path":["api","dataset"],"query":[{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner."},{"key":"datasetName","value":"APICreateDatasetExample1","description":"The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022"}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 16:59:31 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"4251"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"f414be5b-1eb2-4d0b-afdc-5e61533353f9"},{"key":"x-amz-apigw-id","value":"UbEGFHDWoAMEaZw="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ede6f3-701d813972f2246b3be07ce6"}],"cookie":[],"responseTime":null,"body":"{\n \"initializationWorkflow\": {\n \"Create Dataset IAM Execution Role\": {\n \"startDatetime\": 1710089815945,\n \"task\": \"Create Dataset IAM Execution Role\",\n \"endDatetime\": 1710089816513,\n \"status\": \"COMPLETE\"\n },\n \"Create Dataset Code Build Project\": {\n \"startDatetime\": 1710089816693,\n \"task\": \"Create Dataset Code Build Project\",\n \"endDatetime\": 1710089816834,\n \"status\": \"COMPLETE\"\n },\n \"Create Dataset Code Builds\": {\n \"startDatetime\": 1710089816945,\n \"task\": \"Create Dataset Code Builds\",\n \"endDatetime\": 1710089817023,\n \"status\": \"COMPLETE\"\n },\n \"Write Connector - Create Kinesis Stream\": {\n \"startDatetime\": 1710089849362,\n \"task\": \"Write Connector - Create Kinesis Stream\",\n \"endDatetime\": 1710089854911,\n \"status\": \"COMPLETE\"\n },\n \"Error Connector - Create Error Bucket\": {\n \"startDatetime\": 1710089855099,\n \"task\": \"Error Connector - Create Error Bucket\",\n \"endDatetime\": 1710089855869,\n \"status\": \"COMPLETE\"\n },\n \"Create Internal Task Database\": {\n \"startDatetime\": 1710089886424,\n \"task\": \"Create Internal Task Database\",\n \"endDatetime\": 1710089886470,\n \"status\": \"COMPLETE\"\n },\n \"Create Internal Queues\": {\n \"startDatetime\": 1710089886615,\n \"task\": \"Create Internal Queues\",\n \"endDatetime\": 1710089886684,\n \"status\": \"COMPLETE\"\n },\n \"Compute Engine - Create Python ECR Image Lambda Function (1/3)\": {\n \"startDatetime\": 1710089887000,\n \"task\": \"Compute Engine - Create Python ECR Image Lambda Function (1/3)\",\n \"endDatetime\": 1710089902333,\n \"status\": \"COMPLETE\"\n },\n \"Compute Engine - Create Python ECR Image Lambda Function (2/3)\": {\n \"startDatetime\": 1710089967019,\n \"task\": \"Compute Engine - Create Python ECR Image Lambda Function (2/3)\",\n \"endDatetime\": 1710089967556,\n \"status\": \"COMPLETE\"\n },\n \"Compute Engine - Create Python ECR Image Lambda Function (3/3)\": {\n \"startDatetime\": 1710089967694,\n \"task\": \"Compute Engine - Create Python ECR Image Lambda Function (3/3)\",\n \"endDatetime\": 1710089967832,\n \"status\": \"COMPLETE\"\n },\n \"Complete Dataset Code Builds\": {\n \"startDatetime\": 1710089967938,\n \"task\": \"Complete Dataset Code Builds\",\n \"endDatetime\": 1710089968027,\n \"status\": \"COMPLETE\"\n },\n \"Compute Engine - Create Data Task Lambda Function (1/4)\": {},\n \"Compute Engine - Create Data Task Lambda Function (2/4)\": {},\n \"Compute Engine - Create Data Task Lambda Function (3/4)\": {},\n \"Compute Engine - Create Data Task Lambda Function (4/4)\": {},\n \"Compute Engine - Task State Monitor Process (1/3)\": {},\n \"Compute Engine - Task State Monitor Process (2/3)\": {},\n \"Compute Engine - Task State Monitor Process (3/3)\": {},\n \"Secure Dataset IAM Execution Role\": {},\n \"Grant Customer Account Access\": {},\n \"Create Tasks (1/2)\": {},\n \"Create Tasks (2/2)\": {},\n \"Finalize Initialization\": {}\n },\n \"dataset\": {\n \"datasetName\": \"APICreateDatasetExample1\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"readConnector\": {\n \"readerType\": \"SINGLEFILEREADER\",\n \"bucketName\": \"commoncrawl\",\n \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n \"connectorDestination\": \"S3\",\n \"interfaceECRImageResourceLocation\": \"Customer\",\n \"artifactImplementationLanguage\": \"PYTHON\",\n \"region\": \"us-east-1\",\n \"bucketResourceLocation\": \"Customer\"\n },\n \"writeConnector\": {\n \"connectorDestination\": \"KINESIS\",\n \"kinesisShardCount\": 1,\n \"kinesisStreamName\": \"tldwc199acff350c44fd5a693059e22c0f040\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"errorConnector\": {\n \"bucketName\": \"tldec199acff350c44fd5a693059e22c0f040\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA\",\n \"memoryLimitInMegabytes\": 5120,\n \"concurrency\": 5,\n \"timeoutInSeconds\": 900\n },\n \"manifestFile\": {\n \"readerType\": \"SINGLEFILEREADER\",\n \"manifestType\": \"S3ReaderTextManifestFile\",\n \"region\": \"us-east-1\",\n \"fileContents\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00000.warc.wet.gz\\r\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00001.warc.wet.gz\\r\\ncrawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00002.warc.wet.gz\"\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"199acff350c44fd5a693059e22c0f040\",\n \"datasetStatus\": \"INITIALIZING\",\n \"datasetProgress\": {},\n \"executionLogs\": [],\n \"createDatetime\": 1710089797929,\n \"updateDatetime\": 1710089816499\n }\n}"}],"_postman_id":"3dcf94b7-b2ca-428d-ba8b-ea12daceeec1"}],"id":"8a1bd85c-21ed-45c2-9e8e-156d16ed9753","description":"

Datasets are an aggregate unit of work. A dataset will have tasks for the different work items in the dataset. The Control SDK has a number of APIs to manage datasets, for example, you can create datasets, list datasets, view datasets, manage the dataset's lifecycle (descale / freeze / delete), update dataset's code jar / ecr image and update a dataset's compute configuration.

#Let's Data's datasets resource currently supports these apis:

dataset
\n
- view a dataset
\n
dataset/create
\n
- create a dataset
\n
dataset/list
\n
- list all datasets
\n
dataset/delete
\n
- delete a dataset
- view the status of a delete request
\n
dataset/code
\n
- update (update code jar)
- view (view status of existing update code request)
\n
dataset/compute
\n
- update (update dataset compute config)
\n

\n","_postman_id":"8a1bd85c-21ed-45c2-9e8e-156d16ed9753"},{"name":"tasks","item":[{"name":"redrive","item":[{"name":"View Task Redrive Status","id":"20c689c0-0366-4731-81af-3f3fcc30b4fe","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/tasks/redrive?tenantId=tenantId&userId=userId&datasetName=DDBReader1&redriveId=7788b6ed-7070-43e1-8db5-e0fa7ff1276d","description":"

tasks/redrive GET

View the progress of a dataset's redrive tasks workflow by issuing a GET on the tasks/redrive resource.

Input Parameters:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For Example, 078260ed-3124-4de0-8eee-cc5b5025e7ad (TODO - this can be optional, API gets it from token)
datasetName: The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022
redriveId: [Optional] The requestId (also called redriveId) for a redrive request. If redriveId is not specified, details of all the redrive requests for the dataset are returned. If redriveId is specified, details for the specific redrive request are returned.

Example

# view details of the redrive request with redriveId '7788b6ed-7070-43e1-8db5-e0fa7ff1276d'\napi/tasks/redrive?tenantId=tenantId&userId=userId&datasetName=DDBReader1&redriveId=7788b6ed-7070-43e1-8db5-e0fa7ff1276d\n# # view details of all the redrive requests for the dataset 'DDBReader1'\napi/tasks/redrive?tenantId=tenantId&userId=userId&datasetName=DDBReader1\n\n

Output Parameters:

The HttpStatusCode of the response can be looked at to determine success / error. The response body is JSON that has details about the dataset, currentRedrives and completedRedrives. The response body JSON is as follows:

Update Dataset Code JAR response: The Update Dataset Code JAR response has the following elements.

          {\n              \"currentRedrives\": {\n                  \"Initialize\": {\n                      \"startDatetime\": 1703051294717,\n                      \"task\": \"Initialize\",\n                      \"taskRedriveRequest\": {\n                          \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n                          \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n                          \"datasetName\": \"DDBReader1\",\n                          \"datasetId\": \"36d407c4235c453a04b1d8c4a2f1d9cc\",\n                          \"requestType\": \"REDRIVE\",\n                          \"requestId\": \"7b9a9afc-bae8-4417-8a9e-3e2dbea1da0a\",\n                          \"requestStatus\": \"CREATED\",\n                          \"createDatetime\": 1703051294854,\n                          \"updateDatetime\": 1703051294854,\n                          \"taskRedrivePolicy\": \"Resume tasks from last checkpoints\",\n                          \"taskRedriveSelection\": \"Redrive All Error Tasks\",\n                          \"taskIds\": null\n                      },\n                      \"endDatetime\": 1703051294878,\n                      \"status\": \"COMPLETE\"\n                  }\n              },\n              \"dataset\": {\n                  \"datasetName\": \"DDBReader1\",\n                  \"region\": \"us-east-1\",\n                  \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n                  \"customerAccountForAccess\": \"151166716410\",\n                  \"customerAccessRoleArn\": \"arn:aws:iam::223413462631:role/TestCustomerAccess36d407c4235c453a04b1d8c4a2f1d9ccIAMRole\",\n                  \"readConnector\": {\n                      \"readerType\": \"DYNAMODBTABLEREADER\",\n                      \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n                      \"throwOnMessageReadFail\": false,\n                      \"connectorDestination\": \"DYNAMODB\",\n                      \"interfaceECRImageResourceLocation\": \"Customer\",\n                      \"artifactImplementationLanguage\": \"JAVASCRIPT\",\n                      \"region\": \"us-east-1\",\n                      \"tableName\": \"tldwcd4354980b12545d7d23a9f72b0f70b38\",\n                      \"tableResourceLocation\": \"LetsData\"\n                  },\n                  \"writeConnector\": {\n                      \"queueMaxReceiveCount\": 2147483647,\n                      \"connectorDestination\": \"SQS\",\n                      \"queueVisibilityTimeout\": 300,\n                      \"messageIdAttributeName\": \"docId\",\n                      \"queueRetentionInSecs\": 1209600,\n                      \"throwOnMessageSendFail\": false,\n                      \"resourceLocation\": \"LetsData\",\n                      \"queueName\": \"tldwc36d407c4235c453a04b1d8c4a2f1d9cc\",\n                      \"messageGroupIdAttributeName\": null,\n                      \"messageDeduplicationIdAttributeName\": null,\n                      \"region\": \"us-east-1\",\n                      \"queueEnableDeduplication\": false,\n                      \"queueAccountId\": \"223413462631\"\n                  },\n                  \"errorConnector\": {\n                      \"bucketName\": \"tldec36d407c4235c453a04b1d8c4a2f1d9cc\",\n                      \"connectorDestination\": \"S3\",\n                      \"region\": \"us-east-1\",\n                      \"resourceLocation\": \"LetsData\"\n                  },\n                  \"computeEngine\": {\n                      \"logLevel\": \"WARN\",\n                      \"computeEngineType\": \"LAMBDA\",\n                      \"memoryLimitInMegabytes\": 10240,\n                      \"concurrency\": 5,\n                      \"timeoutInSeconds\": 900\n                  },\n                  \"manifestFile\": {\n                      \"readerType\": \"DYNAMODBTABLEREADER\",\n                      \"manifestType\": \"DynamoDBTableReaderManifest\",\n                      \"readerTaskStopCondition\": \"SingleTableScan\",\n                      \"region\": \"us-east-1\",\n                      \"numReaderTasks\": 4\n                  },\n                  \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n                  \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n                  \"datasetId\": \"36d407c4235c453a04b1d8c4a2f1d9cc\",\n                  \"datasetStatus\": \"STOPPING_COMPLETE\",\n                  \"datasetProgress\": {\n                      \"totalTasks\": 4,\n                      \"completedTasks\": 2,\n                      \"errorTasks\": 1\n                  },\n                  \"executionLogs\": [\n                      {\n                          \"startDatetime\": 1703049424727,\n                          \"endDatetime\": 1703050338992\n                      },\n                      {\n                          \"startDatetime\": 1703051060704,\n                          \"endDatetime\": 1703051114140\n                      },\n                      {\n                          \"startDatetime\": 1703051374306,\n                          \"endDatetime\": 1703051425770\n                      },\n                      {\n                          \"startDatetime\": 1703051556786,\n                          \"endDatetime\": null\n                      }\n                  ],\n                  \"createDatetime\": 1703048644180,\n                  \"updateDatetime\": 1707510217627\n              },\n              \"completedRedrives\": [\n                  {\n                      \"Initialize\": {\n                          \"startDatetime\": 1703051059927,\n                          \"task\": \"Initialize\",\n                          \"taskRedriveRequest\": {\n                              \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n                              \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n                              \"datasetName\": \"DDBReader1\",\n                              \"datasetId\": \"36d407c4235c453a04b1d8c4a2f1d9cc\",\n                              \"requestType\": \"REDRIVE\",\n                              \"requestId\": \"7788b6ed-7070-43e1-8db5-e0fa7ff1276d\",\n                              \"requestStatus\": \"CREATED\",\n                              \"createDatetime\": 1703051049654,\n                              \"updateDatetime\": 1703051049654,\n                              \"taskRedrivePolicy\": \"Resume tasks from last checkpoints\",\n                              \"taskRedriveSelection\": \"Redrive All Error Tasks\",\n                              \"taskIds\": null\n                          },\n                          \"endDatetime\": 1703051059928,\n                          \"status\": \"COMPLETE\"\n                      },\n                      \"Compute Redrive Task List\": {\n                          \"startDatetime\": 1703051060080,\n                          \"task\": \"Compute Redrive Task List\",\n                          \"endDatetime\": 1703051060102,\n                          \"status\": \"COMPLETE\"\n                      },\n                      \"Update Task State\": {\n                          \"startDatetime\": 1703051060380,\n                          \"task\": \"Update Task State\",\n                          \"endDatetime\": 1703051060390,\n                          \"status\": \"COMPLETE\"\n                      },\n                      \"Enqueue Tasks For Processing\": {\n                          \"startDatetime\": 1703051060458,\n                          \"task\": \"Enqueue Tasks For Processing\",\n                          \"endDatetime\": 1703051060637,\n                          \"status\": \"COMPLETE\"\n                      },\n                      \"Finalize Redrive Request\": {\n                          \"startDatetime\": 1703051060688,\n                          \"task\": \"Finalize Redrive Request\",\n                          \"endDatetime\": 1703051060720,\n                          \"status\": \"COMPLETE\"\n                      }\n                  }\n              ]\n          }\n\n

currentRedrives: These are the status of the individual steps of the tasks redrive workflow for redrives that are currently in progress (Completed redrives are in the completedRedrives node).
\n
dataset: This is the dataset json document that has details about the read, write and error connectors, the manifest file, the compute engine, access grants and system's internal details about the datasetStatus, progress and execution logs. datasetStatus should tell you the latest state the dataset is in. Details at: https://www.letsdata.io/docs#datasets
\n
completedRedrives: These are the status of the individual steps of the tasks redrive workflow for redrives that have been completed for the dataset. If redriveId was specified in the request, this will have the details for the specified redriveId only. When redriveId is not specified, this will list all the redrives that have completed for the dataset.
\n

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

Request successfully retrieved the update dataset code request status for the dataset. The response body has the requestStatus, dataset details and the update workflow.

            {\n                \"currentRedrives\": {\n                    ...\n                },\n                \"dataset\": {\n                    ...\n                },\n                \"completedRedrives\": [\n                    ...\n                ]\n             }\n\n

404:

The dataset for the tenantId, userId and datasetName was not found in the database. An empty requestStatus, dataset and update workflow is returned in the response JSON.
\n
```
            {\n              \"currentRedrives\": { },\n              \"dataset\": { },\n              \"completedRedrives\": [ ]\n            }        \n\n
```
\n

The dataset exists but the redrive request does not exist in the database. In this case, dataset details are returned with an empty currentRedrives and completedRedrives.

            {\n              \"currentRedrives\": { },\n              \"dataset\": {\n                ...\n              },\n              \"completedRedrives\": [ ]\n            }        \n\n

500:

An unexpected error has occurred.

            {\n            \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n            \"message\": \"Internal Server Error, please try again later.\"\n            }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
\n

Docs:

You can learn about Datasets and their lifecycle at: https://www.letsdata.io/docs#datasets
You can learn about Error Handling in #Let's Data at: https://www.letsdata.io/docs#errorhandling

\n","urlObject":{"path":["api","tasks","redrive"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

\n","type":"text/plain"},"key":"userId","value":"userId"},{"description":{"content":"

The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022

\n","type":"text/plain"},"key":"datasetName","value":"DDBReader1"},{"description":{"content":"

[Optional] The requestId (also called redriveId) for a redrive request. The requestId is used to view the details about a redrive request.

\n","type":"text/plain"},"key":"redriveId","value":"7788b6ed-7070-43e1-8db5-e0fa7ff1276d"}],"variable":[]}},"response":[{"id":"51954e98-8033-4c64-98ce-1a12d9b59f26","name":"Example - View Task Redrive Status","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/tasks/redrive?tenantId=tenantId&userId=userId&datasetName=DDBReader1&redriveId=7788b6ed-7070-43e1-8db5-e0fa7ff1276d","host":["https://www.letsdata.io"],"path":["api","tasks","redrive"],"query":[{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner."},{"key":"datasetName","value":"DDBReader1","description":"The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022"},{"key":"redriveId","value":"7788b6ed-7070-43e1-8db5-e0fa7ff1276d","description":"[Optional] The requestId (also called redriveId) for a redrive request. The requestId is used to view the details about a redrive request."}]}},"status":"Not Found","code":404,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:32:44 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"3399"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"b4208036-be4a-4d33-9d94-5eea2016a496"},{"key":"x-amz-apigw-id","value":"UbjU7GpFIAMEPPw="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee18ec-107448476cff020c03f3335a"}],"cookie":[],"responseTime":null,"body":"{\n \"currentRedrives\": {},\n \"dataset\": {\n \"datasetName\": \"DDBReader1\",\n \"region\": \"us-east-1\",\n \"accessGrantRoleArn\": \"arn:aws:iam::151166716410:role/CommonCrawlAccessToIAMUser\",\n \"customerAccountForAccess\": \"151166716410\",\n \"customerAccessRoleArn\": \"arn:aws:iam::223413462631:role/TestCustomerAccess36d407c4235c453a04b1d8c4a2f1d9ccIAMRole\",\n \"readConnector\": {\n \"readerType\": \"DYNAMODBTABLEREADER\",\n \"interfaceECRImagePath\": \"151166716410.dkr.ecr.us-east-1.amazonaws.com/letsdata_python_functions:latest\",\n \"throwOnMessageReadFail\": false,\n \"connectorDestination\": \"DYNAMODB\",\n \"interfaceECRImageResourceLocation\": \"Customer\",\n \"artifactImplementationLanguage\": \"JAVASCRIPT\",\n \"region\": \"us-east-1\",\n \"tableName\": \"tldwcd4354980b12545d7d23a9f72b0f70b38\",\n \"tableResourceLocation\": \"LetsData\"\n },\n \"writeConnector\": {\n \"queueMaxReceiveCount\": 2147483647,\n \"connectorDestination\": \"SQS\",\n \"queueVisibilityTimeout\": 300,\n \"messageIdAttributeName\": \"docId\",\n \"queueRetentionInSecs\": 1209600,\n \"throwOnMessageSendFail\": false,\n \"resourceLocation\": \"LetsData\",\n \"queueName\": \"tldwc36d407c4235c453a04b1d8c4a2f1d9cc\",\n \"messageGroupIdAttributeName\": null,\n \"messageDeduplicationIdAttributeName\": null,\n \"region\": \"us-east-1\",\n \"queueEnableDeduplication\": false,\n \"queueAccountId\": \"223413462631\"\n },\n \"errorConnector\": {\n \"bucketName\": \"tldec36d407c4235c453a04b1d8c4a2f1d9cc\",\n \"connectorDestination\": \"S3\",\n \"region\": \"us-east-1\",\n \"resourceLocation\": \"LetsData\"\n },\n \"computeEngine\": {\n \"logLevel\": \"WARN\",\n \"computeEngineType\": \"LAMBDA\",\n \"memoryLimitInMegabytes\": 10240,\n \"concurrency\": 5,\n \"timeoutInSeconds\": 900\n },\n \"manifestFile\": {\n \"readerType\": \"DYNAMODBTABLEREADER\",\n \"manifestType\": \"DynamoDBTableReaderManifest\",\n \"readerTaskStopCondition\": \"SingleTableScan\",\n \"region\": \"us-east-1\",\n \"numReaderTasks\": 4\n },\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetId\": \"36d407c4235c453a04b1d8c4a2f1d9cc\",\n \"datasetStatus\": \"STOPPING_COMPLETE\",\n \"datasetProgress\": {\n \"totalTasks\": 4,\n \"completedTasks\": 2,\n \"errorTasks\": 1\n },\n \"executionLogs\": [\n {\n \"startDatetime\": 1703049424727,\n \"endDatetime\": 1703050338992\n },\n {\n \"startDatetime\": 1703051060704,\n \"endDatetime\": 1703051114140\n },\n {\n \"startDatetime\": 1703051374306,\n \"endDatetime\": 1703051425770\n },\n {\n \"startDatetime\": 1703051556786,\n \"endDatetime\": null\n }\n ],\n \"createDatetime\": 1703048644180,\n \"updateDatetime\": 1707510217627\n },\n \"completedRedrives\": [\n {\n \"Initialize\": {\n \"startDatetime\": 1703051059927,\n \"task\": \"Initialize\",\n \"taskRedriveRequest\": {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"DDBReader1\",\n \"datasetId\": \"36d407c4235c453a04b1d8c4a2f1d9cc\",\n \"requestType\": \"REDRIVE\",\n \"requestId\": \"7788b6ed-7070-43e1-8db5-e0fa7ff1276d\",\n \"requestStatus\": \"CREATED\",\n \"createDatetime\": 1703051049654,\n \"updateDatetime\": 1703051049654,\n \"taskRedrivePolicy\": \"Resume tasks from last checkpoints\",\n \"taskRedriveSelection\": \"Redrive All Error Tasks\",\n \"taskIds\": null\n },\n \"endDatetime\": 1703051059928,\n \"status\": \"COMPLETE\"\n },\n \"Compute Redrive Task List\": {\n \"startDatetime\": 1703051060080,\n \"task\": \"Compute Redrive Task List\",\n \"endDatetime\": 1703051060102,\n \"status\": \"COMPLETE\"\n },\n \"Update Task State\": {\n \"startDatetime\": 1703051060380,\n \"task\": \"Update Task State\",\n \"endDatetime\": 1703051060390,\n \"status\": \"COMPLETE\"\n },\n \"Enqueue Tasks For Processing\": {\n \"startDatetime\": 1703051060458,\n \"task\": \"Enqueue Tasks For Processing\",\n \"endDatetime\": 1703051060637,\n \"status\": \"COMPLETE\"\n },\n \"Finalize Redrive Request\": {\n \"startDatetime\": 1703051060688,\n \"task\": \"Finalize Redrive Request\",\n \"endDatetime\": 1703051060720,\n \"status\": \"COMPLETE\"\n }\n }\n ]\n}"}],"_postman_id":"20c689c0-0366-4731-81af-3f3fcc30b4fe"},{"name":"Redrive Error Tasks","id":"8ab87c94-e4ee-41f2-9ee8-be561448c0b2","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"body":{"mode":"raw","raw":"{\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"APICreateDatasetExample1\",\n \"datasetId\": \"199acff350c44fd5a693059e22c0f040\",\n \"requestId\": \"RedriveErrorRequests_1\",\n \"taskRedrivePolicy\": \"Resume tasks from last checkpoints\",\n \"taskRedriveSelection\": \"Redrive All Error Tasks\"\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/tasks/redrive","description":"

tasks/redrive POST

A dataset that has at least 1 error task transitions to the ERRORED state. These errors could be from #Let's Data infrastructure or unhandled exception's from the user's data handler code. For an ERRORED dataset, the errored tasks can be redriven. If the issues that caused the error were transient, then re-running as is would be okay. If there were software issues or issues such as timeout, then the tasks should be redriven after fixing the issue and updating the dataset configuration. Fixes could be updating the implementation jar, fixing timeout / concurrency etc. When a dataset is redriven, it kicks off a redrive workflow which reinitializes the errored tasks. You can view the progress of a redrive workflow by issuing a GET on the tasks/redrive resource (see its docs for details).

Input Parameters:

The API can be used to either a JAR File or ECR Image. The POST body JSON differs slightly for JAR File Update vs ECR Image Update.

The POST body for a JSON request to update the JAR File that has the following schema:

      {\n        \"tenantId\": \"the dataset's tenantId\",\n        \"userId\": \"the dataset's userId\",\n        \"datasetName\": \"the datasetName\",\n        \"datasetId\": \"the datasetId\",\n        \"requestId\": \"the requestId - a user specified identifier for the redrive request, for example, a unique GUID\",\n        \"taskRedrivePolicy\": \"Start tasks from the beginning|Resume tasks from last checkpoints\",\n        \"taskRedriveSelection\": \"Redrive All Error Tasks|Redrive Select Error Tasks\",\n        \"taskIds\": [ \"specify taskIds when the taskSelectionPolicy is 'Redrive Select Error Tasks'\", ...]\n      }\n\n

Here are the details for the JSON request schema:\n\n

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For Example, --userId 078260ed-3124-4de0-8eee-cc5b5025e7ad (TODO - this can be optional, API gets it from token)
datasetName: The dataset name for the dataset that the user wants to run the command for.
datasetId: The datasetId for the dataset the user wants to run the command for. The datasetId can be retrieved from the dataset JSON returned by the View Dataset command (GET /dataset)
requestId: The requestId - a user specified unique identifier for the redrive request, for example, a GUID. You'll be using this requestId to view the details of the redrive request.
taskRedriveSelection: To redrive the tasks, you need to tell #Let's Data which tasks should be redriven. The taskRedriveSelection allows you to specify whether you would like to rerun all error tasks ('Redrive All Error Tasks') or if select tasks specified by the taskIds should be rerun('Redrive Select Error Tasks').
taskRedrivePolicy: The #Let's Data tasks come with checkpointing where the tasks saves its progress in the task database. In case of errors, the error tasks can be redriven from the last saved checkpoint or start executing from the beginning. The taskRedrivePolicy specifies this config when redriving tasks. The taskRedrivePolicy can be set to 'Resume tasks from last checkpoints' to rerun from the last saved state, or it can be set to 'Start tasks from the beginning' to restart the tasks from the beginning.
*taskIds: The taskIds need to be specified when the taskSelectionPolicy is set to 'Redrive Select Error Tasks'. This is list of taskIds up to a maximum of 100 tasks.

Examples:

RedriveAllErrorTasks: For example, a POST request to the tasks/redrive resource with the following body would redrive error tasks for the dataset named IndexWebCrawlDataDec2022, datasetId 27251ad51f2addb2e3952cbbe12d97dc belonging to the tenant (tenantId: d5feaf90-71a9-41ee-b1b9-35e4242c3155) and user (userId: accb3567-2b6e-41ae-b00d-6ce1f9a58d94). taskRedrivePolicy Redrive All Error Tasks will redrive all error tasks and taskRedrivePolicy Resume tasks from last checkpoints will resume these from the last checkpoints. The redrive request is assigned a requestId RedriveErrorRequests_1.
\n
```
      {\n        \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n        \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n        \"datasetName\": \"IndexWebCrawlDataDec2022\",\n        \"datasetId\": \"27251ad51f2addb2e3952cbbe12d97dc\",\n        \"requestId\": \"RedriveErrorRequests_1\",\n        \"taskRedrivePolicy\": \"Resume tasks from last checkpoints\",\n        \"taskRedriveSelection\": \"Redrive All Error Tasks\"\n      }\n\n
```
\n
RedriveSelectErrorTasks: For example, a POST request to the tasks/redrive resource with the following body would redrive error tasks for the dataset named IndexWebCrawlDataDec2022, datasetId 27251ad51f2addb2e3952cbbe12d97dc belonging to the tenant (tenantId: d5feaf90-71a9-41ee-b1b9-35e4242c3155) and user (userId: accb3567-2b6e-41ae-b00d-6ce1f9a58d94). taskRedrivePolicy Redrive Select Error Tasks will redrive the error tasks with taskIds specified in the taskIds list and taskRedrivePolicy Start tasks from the beginning will restart these tasks. The redrive request is assigned a requestId RedriveErrorRequests_2.
\n
```
      {\n        \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n        \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n        \"datasetName\": \"IndexWebCrawlDataDec2022\",\n        \"datasetId\": \"27251ad51f2addb2e3952cbbe12d97dc\",\n        \"requestId\": \"RedriveErrorRequests_2\",\n        \"taskRedrivePolicy\": \"Start tasks from the beginning\",\n        \"taskRedriveSelection\": \"Redrive Select Error Tasks\",\n        \"taskIds\": [\"01c06add9fb696bf5f69976661cedd57\", \"001c1efa514d2d47ef895c6c717eb06d\"]\n      }\n\n
```
\n

Output Parameters:

The HttpStatusCode of the response can be looked at to determine success / error. The response body is JSON that has the status of the update request. The response body JSON has the following schema:

    {\n        \"statusCode\": \"<NOT_ALLOWED_AT_THIS_TIME|REQUEST_ALREADY_ENQUEUED|CONCURRENT_REQUEST_IN_PROGRESS|INTERNAL_SERVER_ERROR|SUCCESS|ERROR>\",\n        \"message\": \"String\"\n        \"taskRedriveRequest\" :{\n                \"tenantId\": \"String\",\n                \"userId\": \"String\",\n                \"datasetName\": \"String\",\n                \"datasetId\": \"String\",\n                \"requestType\": \"String\",\n                \"requestId\": \"String\",\n                \"requestStatus\": \"String\",\n                \"createDatetime\": \"Long\",\n                \"updateDatetime\": \"Long\",\n                \"taskRedrivePolicy\": \"String\",\n                \"taskRedriveSelection\": \"String\",\n                \"taskIds\": \"List\",\n        }\n    }\n\n

statusCode: StatusCode of the request - this can be either NOT_ALLOWED_AT_THIS_TIME|REQUEST_ALREADY_ENQUEUED|CONCURRENT_REQUEST_IN_PROGRESS|INTERNAL_SERVER_ERROR|SUCCESS|ERROR. In each of these cases, the Message string has additional details about the status. We allow only single redrive request at a time (CONCURRENT_REQUEST_IN_PROGRESS) and disallow redrive requests when tasks are running and dataset is in processing status(NOT_ALLOWED_AT_THIS_TIME).
message: The error / success message that has the details about the status of the request.
taskRedriveRequest: For a success response, an taskRedriveRequest map is returned which has the request details. The important properties in this request map are the requestStatus and the requestId. The requestId can be used to view the status of the redrive requests by issuing a GET on the tasks/redrive resource (see its docs for details).

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

Request was successfully enqueued

        {\n            \"statusCode\": \"SUCCESS\",\n            \"message\": \"REDRIVE request successfully enqueued.\"\n            \"taskRedriveRequest\":\n            {\n              ... // the task redrive request from the api call\n            }\n        }\n\n

404:

The dataset for the tenantId, userId and datasetName was not found in the database.

        {\n            \"statusCode\": \"NOT_FOUND\",\n            \"message\": \"Dataset not found for the tenantId: <tenantId>, userId: <userId>, datasetName: <datasetName>\"\n        }\n\n

409
\n

Request has already been enqueued for the REDRIVE

              {\n                  \"statusCode\": \"REQUEST_ALREADY_ENQUEUED\",\n                  \"message\": \"The request to REDRIVE has already been enqueued in the system.\"\n              }\n\n

Request is not allowed at this time since a REDRIVE request is already in progress.

            {\n                \"statusCode\": \"CONCURRENT_REQUEST_IN_PROGRESS\",\n                \"message\": \"The system is currently working on a different REDRIVE request. Check to see if the request is a duplicate of the existing request. enqueuedRequest: <enqueuedRequest>, requested: <requested>\"\n            }\n\n

Request is not allowed at this time since a concurrent update request is in progress (for example, update code, update compute configuration, redriving etc)

            {\n                \"statusCode\": \"CONCURRENT_REQUEST_IN_PROGRESS\",\n                \"message\": \"A concurrent request is being processed by the system. enqueuedRequest: <enqueuedRequest>\"\n            }\n\n

Request is not allowed at this time since the current datasetStatus does not allow Update Dataset Code requests. Redrive requests are only allowed when datasetStatus is ERRORED.

          {\n              \"statusCode\": \"NOT_ALLOWED_AT_THIS_TIME\",\n              \"message\": \"Dataset is currently in <datasetStatus> state. REDRIVE is not allowed in this state.\"\n          }\n\n

500:

Request could not be written to the database, possibly due to db conflict. Retrying may fix the issue.

            {\n                \"statusCode\": \"ERROR\",\n                \"message\": \"REDRIVE request could not be queued - errorCode: <dbErrorCode>\"\n            }\n\n

An unexpected error has occurred.

            {\n                \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n                \"message\": \"Internal Server Error, please try again later.\"\n            }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
\n

Details

The dataset when redriven goes through an redrive workflow where the tasks are reinitialized. Users can view the progress of the redrive workflow by calling the datasets view CLI command / API. The redrive workflow is expected to list the following steps in a finite sequence of steps.

Initialize: Initializes the dataset for redriving.
\n
Compute Redrive Task List: Computes the tasklist of tasks that are being requested for redrive.
\n
Update Task State: Updates the task state, checkpoints (if needed) so that task can be redriven.
\n
Enqueue Tasks For Processing} detail={Enqueue the tasks for processing by the Data Task Function.
\n

Finalize Redrive Request: Finalize the redrive request.
You can view the redrive workflow details by issuing a GET on dataset resource. The workflow details are a map of the workflow's step name and the step's latest result. Steps that have not be started show up as empty maps. You may also see some steps in status ERROR and then on a later invocation show as COMPLETED, this is fine since the steps are retried until complete and we expect some transient timeout failures in waiting for resources to be initialized. (TODO: We are working on moving all transient ERROR states to a WAIT state so that the ERROR is reliably an error - improved dev experience).
Here is an abbreviated example JSON redriveWorkflow list:

        [\n            {\n                \"Compute Redrive Task List\": {\n                        \"task\": \"Compute Redrive Task List\",\n                        \"status\": \"COMPLETED\",\n                        \"startDatetime\":1671389022125,\n                        \"endDatetime\": 1671389622842\n                },\n                \"Update Task State\": {\n                        \"task\": \"Update Task State\",\n                        \"status\": \"COMPLETED\",\n                        \"startDatetime\":1671389682854,\n                        \"endDatetime\": 1671389742457\n                },\n                \"Finalize Redrive Request\": {},\n                ...\n            },\n            {\n                ...\n            },\n            ...\n        ]\n\n

Docs

You can learn about Datasets and their lifecycle at: https://www.letsdata.io/docs#datasets
You can learn about Error Handling in #Let's Data at: https://www.letsdata.io/docs#errorhandling

\n","urlObject":{"path":["api","tasks","redrive"],"host":["https://www.letsdata.io"],"query":[],"variable":[]}},"response":[{"id":"f6f08b42-2245-4987-9a26-a40741cb0981","name":"Example - Redrive Error Tasks","originalRequest":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"body":{"mode":"raw","raw":"{\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"APICreateDatasetExample1\",\n \"datasetId\": \"199acff350c44fd5a693059e22c0f040\",\n \"requestId\": \"RedriveErrorRequests_1\",\n \"taskRedrivePolicy\": \"Resume tasks from last checkpoints\",\n \"taskRedriveSelection\": \"Redrive All Error Tasks\"\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/tasks/redrive"},"status":"Conflict","code":409,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:32:02 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"130"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"5e37953f-1bf7-4dfb-b462-7bf045144787"},{"key":"x-amz-apigw-id","value":"UbjNiEXloAMEmkA="},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee18bc-1390935e491232db79413f02"}],"cookie":[],"responseTime":null,"body":"{\n \"statusCode\": \"NOT_ALLOWED_AT_THIS_TIME\",\n \"message\": \"Dataset is currently in DELETED state. REDRIVE is not allowed in this state.\"\n}"}],"_postman_id":"8ab87c94-e4ee-41f2-9ee8-be561448c0b2"}],"id":"975d067f-8656-4e90-a1a1-05775c7c2d3a","description":"

A dataset that has atleast 1 error task transitions to the ERRORED state. These errors could be from #Let's Data infrastructure or unhandled exception's from the user's data handler code. For an ERRORED dataset, the errored tasks can be redriven. If the issues that caused the error were transient, then re-running as is would be okay. If there were software issues or issues such as timeout, then the tasks should be redriven after fixing the issue and updating the dataset configuration. Fixes could be updating the implementation jar, fixing timeout / concurrency etc. This resource has api to redrive tasks and view status of existing redrive requests.

\n","_postman_id":"975d067f-8656-4e90-a1a1-05775c7c2d3a"},{"name":"list","item":[{"name":"List Dataset Tasks","id":"2b1cc823-a00b-4878-9b1c-8163f7585782","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/tasks/list?tenantId=tenantId&userId=userId&datasetName=TestCommonCrawl","description":"

tasks/list GET

The list of the tasks for a dataset are returned by the tasks/list GET API. This returns a list of the tasks, taskLogs and an optional next token to paginate the next page. The list api also supports a few different useful filters: filter by taskStatus, taskIds, limiting the results using a limit value and paginating using next tokens. We'd look at these in 'Input Parameters' section.

Input Parameters:

datasetName: The dataset name for the dataset that the user wants to run the command for. For example, &datasetName=IndexWebCrawlDataDec2022
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For example, &userId=078260ed-3124-4de0-8eee-cc5b5025e7ad
tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
taskStatus: [Optional] Filter the results by returning results whose taskStatus is equal to the given taskStatus, where the taskStatus needs to be from the taskStatus set: CREATED, PROCESSING, COMPLETED, ERROR. &taskStatus=COMPLETED
taskIds: [Optional] Filter the results by the tasks whose taskIds are in the given taskIds. This is a comma separated list of taskIds up to a maximum of 100 tasks. For example, &taskIds=01c06add9fb696bf5f69976661cedd57,001c1efa514d2d47ef895c6c717eb06d
limit: [Optional] The limit for the number of results that are to be returned by the command. This is used in conjunction with pagination when large number of records are being retrieved. This is optional and the system does set some meaningful defaults in most APIs. Also, this limit is a hint for the API and the results are not guaranteed to be exactly the same number as the limit. The user needs to handle the following cases when specifying limits:
- The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved.
- The records may be a little more than the limit (~<10 or so). User should handle these gracefully.
  Rule of thumb in using limits is to treat it as a soft max limit. For example, &limit=100
\n
next: [Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved. For example, &next=dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw+4MpoRCd/2eL3WaI2IHe3/bLYH//gAYXtGXI01BZ5d5NwdWcVf7o5HGGpbvKibkd0zDfUUiJjI/aJQaSb2tM5mwflwszzdHuyNolNNtXwij1TjyGqLny2p0O5PquoYig8iq8YI=

Output Parameters:

The output is a JSON map that has the following sections:

    {\n        \"tasks\": [\n          {\n            ...\n          },\n          {\n            ...\n          },\n          ...\n        ],\n        \"taskLogs\": [\n          {\n            ...\n          },\n          {\n            ...\n          },\n          ...\n        ],\n        \"next\": \"String\"\n    }\n\n

tasks: This is the list of task json documents that are returned by the list command. These have details about the tasks reader definition, the task's computeDefinition, taskCheckpoint, taskExecutionLogs, taskProgress, taskStatus. Here is an example task json:

    \"tasks\": [\n          {\n              \"dataset\": \"IndexWebCrawlDataDec2022\",\n              \"datasetId\": \"68d2ab6251a55b1264d90cb68f64be2a\",\n              \"tenantId\": \"e7148bad-2415-4a61-9189-7ad14ea5a212\",\n              \"userId\": \"aa072857-ef58-4703-97e1-4c1f455e2c0c\",\n              \"taskId\": \"00009b45de184a92dde4b907b216fcde\",\n              \"taskType\": \"READER\",\n              \"readerDefinition\": {\n                  \"fileTypeFileNameMap\": {\n                      \"WARC\": \"crawl-data/CC-MAIN-2022-27/segments/1656103360935.27/warc/CC-MAIN-20220628081102-20220628111102-00329.warc.gz\",\n                      \"WAT\": \"crawl-data/CC-MAIN-2022-27/segments/1656103360935.27/wat/CC-MAIN-20220628081102-20220628111102-00329.warc.wat.gz\",\n                      \"WET\": \"crawl-data/CC-MAIN-2022-27/segments/1656103360935.27/wet/CC-MAIN-20220628081102-20220628111102-00329.warc.wet.gz\"\n                  },\n                  \"manifestId\": \"WARC:crawl-data/CC-MAIN-2022-27/segments/1656103360935.27/warc/CC-MAIN-20220628081102-20220628111102-00329.warc.gz|WAT:crawl-data/CC-MAIN-2022-27/segments/1656103360935.27/wat/CC-MAIN-20220628081102-20220628111102-00329.warc.wat.gz|WET:crawl-data/CC-MAIN-2022-27/segments/1656103360935.27/wet/CC-MAIN-20220628081102-20220628111102-00329.warc.wet.gz\",\n                  \"readerType\": \"MULTIPLEFILESTATEMACHINEREADER\"\n              },\n              \"computeDefinition\": {\n                  \"workerProcessId\": \"null|a1bcc01a-8096-454d-8ee6-fc474fd836d8\"\n              },\n              \"taskCheckpoint\": {\n                  \"checkpointDatetime\": 1670061847755,\n                  \"checkpointId\": \"https://zzgames.ru/rad/\",\n                  \"checkpointProcessId\": \"null|a1bcc01a-8096-454d-8ee6-fc474fd836d8\",\n                  \"lastProcessedRecordType\": {\n                      \"WARC\": \"metadata,WARC_METADATA_PAYLOAD\",\n                      \"WAT\": \"metadata,WAT_METADATA_WARC_METADATA_PAYLOAD\",\n                      \"WET\": \"conversion,WET_CONVERSION_PAYLOAD\"\n                  },\n                  \"offsetBytes\": {\n                      \"WARC\": 5278456879,\n                      \"WAT\": 1281920960,\n                      \"WET\": 348895043\n                  }\n              },\n              \"taskExecutionLogs\": [\n                  {\n                      \"endDatetime\": 1670061847756,\n                      \"startDatetime\": 1670061431074\n                  }\n              ],\n              \"taskProgress\": {\n                  \"numRecordsErrored\": 86,\n                  \"numRecordsProcessed\": 38921,\n                  \"numRecordsSkipped\": 0\n              },\n              \"taskStatus\": {\n                  \"taskStatus\": \"COMPLETED\"\n              },\n              \"createDatetime\": 1670016826734,\n              \"updateDatetime\": 1670064667143\n          },\n          ...\n    ]\n\n

Details about tasks can be found at: https://www.letsdata.io/docs#tasks

taskLogs: This is the list of taskLogs for the same tasks that are returned in the tasks list. Accessing logs in #Let's Data requires logTokens which are returned in this list (and as next tokens when viewing the logs). The logTokens are the Strings in the \"logs\" list. Why is this a list? Tasks can be rerun and each run creates a log file, so each run will have a log token in this list. The first logToken is for the initial run, second for the first rerun and so on. Here is what a taskLogs list looks like:

       \"taskLogs\": [\n              {\n                  \"logs\": [\n                      \"AukW/Ogg4J5lX4uqtWpf7sjCRILrKV4e9tmkBRBAQ6sUfM+cNKV65aRxpM+FPFxXTyuzz7aM2Q65btk+++m/g/B/fuk5njnL+pz8ZlebwV3hB7KVNUoYhoWZlRwT4gdDWcQkKODBalDRBYnx+/sJZIUiCvcQ2x9+VuotPgdZ6l8SgJY2/DcC7Z4j11lSlzC8q7ot1EFJ8/xFGPPPhEYvMglUFIO0VDNQrJBDD7Tp6gVVP7shVTtBTz2BV4pj8eRFmuYOHuF9aSxsWsAJbhCqF+6LVvYDzCy2A9foZtcVkQ+HbF8iHJrTmzc\n      i8TCXfLuL4V8ByjiR7O0+SfmZ6cffaXgXp2ZP5O0OWmG34grLDFfYhZvBn5FKEBomWKDPwX5E0xXn3HFw/SLdDuNHbZwARJX8588ARkg10YLglirMOvpyrb7XGyRM0maLgt9b27ArNec+T8oEr57HWMpaswajDGeZVXbYC08KjTWlkEh7H2E=\"\n                  ],\n                  \"taskId\": \"000074c042092ef7c31316e70b5570d7\",\n                  \"taskStatus\": \"COMPLETED\"\n              },\n              {\n                  \"logs\": [\n                      \"AukW/Ogg4J5lX4uqtWpf7sjCRILrKV4e9tmkBRBAQ6sUfM+cNKV65aRxpM+FPFxX67GKDL/QzeDkB8hySSOgay5BFm4bR9KExXztceBZBXXutQkbiYGctmLLBG/2leOMFSStUav40lbcKG72b+E1URGxGnooDZ+G7WqjM7sfUkg++yYB2nQQvDA/xUtbmjKdXc/bhp16XhllcU/IWFpAMValZ0LRB+ixMFOEWZczH4IXq2OPrtlhMpO6h9hSoV18aF8H6+e2Fk/xJQKHhy5fGmv4pDIAvc+uYjg3RikzNBe5JVsh9EHm2D292\n      A31x3hW8urPDF7JRRONIWaXnEuXwbnwm/XUyF+AiFn3VDsJoWR57ObRAx/d0BI+kyrFRU3T5EVBuZJORd4CNmcDNJoNeloQANChmmMwGTn2is0I9aDD7z/9TN3VzdbISNnvVLysyIVd252fVQOgIg1rQ/NOtelG5tfH0u2pPGhXaboQNN0=\"\n                  ],\n                  \"taskId\": \"00009b45de184a92dde4b907b216fcde\",\n                  \"taskStatus\": \"COMPLETED\"\n              },\n              {\n                  \"logs\": [\n                      \"AukW/Ogg4J5lX4uqtWpf7sjCRILrKV4e9tmkBRBAQ6sUfM+cNKV65aRxpM+FPFxXFJJbaqv8OE2DD72E4C67RqyXBfNDS896vDzSowyiAKCJBuwo4wao28cdYnOzTUPuphh3DY1xSpBUk6c9Rr4R6C9RzHakJfTKHGLTK/JTPFizSu2afBdLzBEfsJmDhf1YScT25ZDO38KgEtGdC/bXREseonvxyjz9Stta/daTo96tlDAs9F0F+80LK2HR/z612Q0CF/kXGehloYxvC5paKEFzPkWRSMrUjWzPwH5NNKfiDXlD6eivmLzuIw4NqqTFugsewWO\n      mb/Pj658KyhqA/tOvfkd6BXt5ktTkSh21XRyxk6Ji7DWVNqQt5+F/+HS5Wl6vneHMDjRXpcZN9AzIQK5qC8kR9pUsZVxX3qkWwkWwpwEoZ8LEgLx9Mw0e7/+kMYhlxc1/dQdk0jH3WtewY3gkMKVqZOd0QUAmnMRho9Y=\"\n                  ],\n                  \"taskId\": \"000189d54a1811a1764cf43b106023d5\",\n                  \"taskStatus\": \"COMPLETED\"\n              }\n          ],\n\n

next: [Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved.
\n

Actual Example Output:

Here is an actual example output for the command:

    {\n        \"next\": \"dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw+4MpoRCd/2eL3WaI2IHe3/bLYH//gAYXtGXI01BZ5d5NwdWcZIyqNhdiYhwUxmh/cqdf50XIlDkVE8RJa7MKMfJWFLXYHecd/lVNcXAAVp5QceAdJWuETYqY2i4r9BWA2iSuAM=\",\n        \"taskLogs\": [\n            {\n                \"logs\": [\n                    \"AukW/Ogg4J5lX4uqtWpf7sjCRILrKV4e9tmkBRBAQ6sUfM+cNKV65aRxpM+FPFxXFJJbaqv8OE2DD72E4C67RqyXBfNDS896vDzSowyiAKCJBuwo4wao28cdYnOzTUPuphh3DY1xSpBUk6c9Rr4R6C9RzHakJfTKHGLTK/JTPFizSu2afBdLzBEfsJmDhf1YScT25ZDO38KgEtGdC/bXREseonvxyjz9Stta/daTo96tlDAs9F0F+80LK2HR/z612Q0CF/kXGehloYxvC5paKEFzPkWRSMrUjWzPwH5NNKfiDXlD6eivmLzuIw4NqqTFugsewWOmb/Pj658KyhqA/tOvfkd6BXt5ktTkSh21XRyxk6Ji7DWVNqQt5+F/+HS5Wl6vneHMDjRXpcZN9AzIQK5qC8kR9pUsZVxX3qkWwkWwpwEoZ8LEgLx9Mw0e7/+kKlWgqF6rUv/HPnW6++dflBZUoaWGlTPbrOxBBgZhyQk=\"\n                ],\n                \"taskId\": \"000189d54a1811a1764cf43b106023d5\",\n                \"taskStatus\": \"COMPLETED\"\n            },\n            {\n                \"logs\": [\n                    \"AukW/Ogg4J5lX4uqtWpf7sjCRILrKV4e9tmkBRBAQ6sUfM+cNKV65aRxpM+FPFxXTyuzz7aM2Q65btk+++m/g/B/fuk5njnL+pz8ZlebwV3hB7KVNUoYhoWZlRwT4gdDWcQkKODBalDRBYnx+/sJZIUiCvcQ2x9+VuotPgdZ6l8SgJY2/DcC7Z4j11lSlzC8q7ot1EFJ8/xFGPPPhEYvMglUFIO0VDNQrJBDD7Tp6gVVP7shVTtBTz2BV4pj8eRFmuYOHuF9aSxsWsAJbhCqF+6LVvYDzCy2A9foZtcVkQ+HbF8iHJrTmzci8TCXfLuL4V8ByjiR7O0+SfmZ6cffaXgXp2ZP5O0OWmG34grLDFfYhZvBn5FKEBomWKDPwX5E0xXn3HFw/SLdDuNHbZwARJX8588ARkg10YLglirMOvpyrb7XGyRM0maLgt9b27ArDehkl+8xRoUx5I+Lnf6wf5sX/TIkototGjSkOWUP9ps=\"\n                ],\n                \"taskId\": \"000074c042092ef7c31316e70b5570d7\",\n                \"taskStatus\": \"COMPLETED\"\n            },\n            {\n                \"logs\": [\n                    \"AukW/Ogg4J5lX4uqtWpf7sjCRILrKV4e9tmkBRBAQ6sUfM+cNKV65aRxpM+FPFxX67GKDL/QzeDkB8hySSOgay5BFm4bR9KExXztceBZBXXutQkbiYGctmLLBG/2leOMFSStUav40lbcKG72b+E1URGxGnooDZ+G7WqjM7sfUkg++yYB2nQQvDA/xUtbmjKdXc/bhp16XhllcU/IWFpAMValZ0LRB+ixMFOEWZczH4IXq2OPrtlhMpO6h9hSoV18aF8H6+e2Fk/xJQKHhy5fGmv4pDIAvc+uYjg3RikzNBe5JVsh9EHm2D292A31x3hW8urPDF7JRRONIWaXnEuXwbnwm/XUyF+AiFn3VDsJoWR57ObRAx/d0BI+kyrFRU3T5EVBuZJORd4CNmcDNJoNeloQANChmmMwGTn2is0I9aDD7z/9TN3VzdbISNnvVLysjyRLpTRIt5b9uAADu1vXit1ThSEMcRb68G22eH7SX9w=\"\n                ],\n                \"taskId\": \"00009b45de184a92dde4b907b216fcde\",\n                \"taskStatus\": \"COMPLETED\"\n            }\n        ],\n        \"tasks\": [\n            {\n                \"computeDefinition\": {\n                    \"workerProcessId\": \"null|68e6663e-9a27-4605-a9a3-3e24887c5e55\"\n                },\n                \"createDatetime\": 1670016826734,\n                \"dataset\": \"IndexWebCrawlDataDec2022\",\n                \"datasetId\": \"68d2ab6251a55b1264d90cb68f64be2a\",\n                \"readerDefinition\": {\n                    \"fileTypeFileNameMap\": {\n                        \"WARC\": \"crawl-data/CC-MAIN-2022-27/segments/1656104215790.65/warc/CC-MAIN-20220703043548-20220703073548-00391.warc.gz\",\n                        \"WAT\": \"crawl-data/CC-MAIN-2022-27/segments/1656104215790.65/wat/CC-MAIN-20220703043548-20220703073548-00391.warc.wat.gz\",\n                        \"WET\": \"crawl-data/CC-MAIN-2022-27/segments/1656104215790.65/wet/CC-MAIN-20220703043548-20220703073548-00391.warc.wet.gz\"\n                    },\n                    \"manifestId\": \"WARC:crawl-data/CC-MAIN-2022-27/segments/1656104215790.65/warc/CC-MAIN-20220703043548-20220703073548-00391.warc.gz|WAT:crawl-data/CC-MAIN-2022-27/segments/1656104215790.65/wat/CC-MAIN-20220703043548-20220703073548-00391.warc.wat.gz|WET:crawl-data/CC-MAIN-2022-27/segments/1656104215790.65/wet/CC-MAIN-20220703043548-20220703073548-00391.warc.wet.gz\",\n                    \"readerType\": \"MULTIPLEFILESTATEMACHINEREADER\"\n                },\n                \"taskCheckpoint\": {\n                    \"checkpointDatetime\": 1670072777763,\n                    \"checkpointId\": \"https://zyougi.com/en/iphone_se3/\",\n                    \"checkpointProcessId\": \"null|68e6663e-9a27-4605-a9a3-3e24887c5e55\",\n                    \"lastProcessedRecordType\": {\n                        \"WARC\": \"metadata,WARC_METADATA_PAYLOAD\",\n                        \"WAT\": \"metadata,WAT_METADATA_WARC_METADATA_PAYLOAD\",\n                        \"WET\": \"conversion,WET_CONVERSION_PAYLOAD\"\n                    },\n                    \"offsetBytes\": {\n                        \"WARC\": 5098808344,\n                        \"WAT\": 1245478403,\n                        \"WET\": 339866038\n                    }\n                },\n                \"taskExecutionLogs\": [\n                    {\n                        \"endDatetime\": 1670072777763,\n                        \"startDatetime\": 1670072319028\n                    }\n                ],\n                \"taskId\": \"000074c042092ef7c31316e70b5570d7\",\n                \"taskProgress\": {\n                    \"numRecordsErrored\": 203,\n                    \"numRecordsProcessed\": 38520,\n                    \"numRecordsSkipped\": 0\n                },\n                \"taskStatus\": {\n                    \"taskStatus\": \"COMPLETED\"\n                },\n                \"taskType\": \"READER\",\n                \"tenantId\": \"e7148bad-2415-4a61-9189-7ad14ea5a212\",\n                \"updateDatetime\": 1670076296628,\n                \"userId\": \"aa072857-ef58-4703-97e1-4c1f455e2c0c\"\n            },\n            {\n                \"computeDefinition\": {\n                    \"workerProcessId\": \"null|a1bcc01a-8096-454d-8ee6-fc474fd836d8\"\n                },\n                \"createDatetime\": 1670016826734,\n                \"dataset\": \"IndexWebCrawlDataDec2022\",\n                \"datasetId\": \"68d2ab6251a55b1264d90cb68f64be2a\",\n                \"readerDefinition\": {\n                    \"fileTypeFileNameMap\": {\n                        \"WARC\": \"crawl-data/CC-MAIN-2022-27/segments/1656103360935.27/warc/CC-MAIN-20220628081102-20220628111102-00329.warc.gz\",\n                        \"WAT\": \"crawl-data/CC-MAIN-2022-27/segments/1656103360935.27/wat/CC-MAIN-20220628081102-20220628111102-00329.warc.wat.gz\",\n                        \"WET\": \"crawl-data/CC-MAIN-2022-27/segments/1656103360935.27/wet/CC-MAIN-20220628081102-20220628111102-00329.warc.wet.gz\"\n                    },\n                    \"manifestId\": \"WARC:crawl-data/CC-MAIN-2022-27/segments/1656103360935.27/warc/CC-MAIN-20220628081102-20220628111102-00329.warc.gz|WAT:crawl-data/CC-MAIN-2022-27/segments/1656103360935.27/wat/CC-MAIN-20220628081102-20220628111102-00329.warc.wat.gz|WET:crawl-data/CC-MAIN-2022-27/segments/1656103360935.27/wet/CC-MAIN-20220628081102-20220628111102-00329.warc.wet.gz\",\n                    \"readerType\": \"MULTIPLEFILESTATEMACHINEREADER\"\n                },\n                \"taskCheckpoint\": {\n                    \"checkpointDatetime\": 1670061847755,\n                    \"checkpointId\": \"https://zzgames.ru/rad/\",\n                    \"checkpointProcessId\": \"null|a1bcc01a-8096-454d-8ee6-fc474fd836d8\",\n                    \"lastProcessedRecordType\": {\n                        \"WARC\": \"metadata,WARC_METADATA_PAYLOAD\",\n                        \"WAT\": \"metadata,WAT_METADATA_WARC_METADATA_PAYLOAD\",\n                        \"WET\": \"conversion,WET_CONVERSION_PAYLOAD\"\n                    },\n                    \"offsetBytes\": {\n                        \"WARC\": 5278456879,\n                        \"WAT\": 1281920960,\n                        \"WET\": 348895043\n                    }\n                },\n                \"taskExecutionLogs\": [\n                    {\n                        \"endDatetime\": 1670061847756,\n                        \"startDatetime\": 1670061431074\n                    }\n                ],\n                \"taskId\": \"00009b45de184a92dde4b907b216fcde\",\n                \"taskProgress\": {\n                    \"numRecordsErrored\": 86,\n                    \"numRecordsProcessed\": 38921,\n                    \"numRecordsSkipped\": 0\n                },\n                \"taskStatus\": {\n                    \"taskStatus\": \"COMPLETED\"\n                },\n                \"taskType\": \"READER\",\n                \"tenantId\": \"e7148bad-2415-4a61-9189-7ad14ea5a212\",\n                \"updateDatetime\": 1670064667143,\n                \"userId\": \"aa072857-ef58-4703-97e1-4c1f455e2c0c\"\n            },\n            {\n                \"computeDefinition\": {\n                    \"workerProcessId\": \"null|fcfe8b94-0dda-4948-8b1c-0ebd8c5ae4c2\"\n                },\n                \"createDatetime\": 1670016826734,\n                \"dataset\": \"IndexWebCrawlDataDec2022\",\n                \"datasetId\": \"68d2ab6251a55b1264d90cb68f64be2a\",\n                \"readerDefinition\": {\n                    \"fileTypeFileNameMap\": {\n                        \"WARC\": \"crawl-data/CC-MAIN-2022-27/segments/1656104248623.69/warc/CC-MAIN-20220703164826-20220703194826-00219.warc.gz\",\n                        \"WAT\": \"crawl-data/CC-MAIN-2022-27/segments/1656104248623.69/wat/CC-MAIN-20220703164826-20220703194826-00219.warc.wat.gz\",\n                        \"WET\": \"crawl-data/CC-MAIN-2022-27/segments/1656104248623.69/wet/CC-MAIN-20220703164826-20220703194826-00219.warc.wet.gz\"\n                    },\n                    \"manifestId\": \"WARC:crawl-data/CC-MAIN-2022-27/segments/1656104248623.69/warc/CC-MAIN-20220703164826-20220703194826-00219.warc.gz|WAT:crawl-data/CC-MAIN-2022-27/segments/1656104248623.69/wat/CC-MAIN-20220703164826-20220703194826-00219.warc.wat.gz|WET:crawl-data/CC-MAIN-2022-27/segments/1656104248623.69/wet/CC-MAIN-20220703164826-20220703194826-00219.warc.wet.gz\",\n                    \"readerType\": \"MULTIPLEFILESTATEMACHINEREADER\"\n                },\n                \"taskCheckpoint\": {\n                    \"checkpointDatetime\": 1670034196415,\n                    \"checkpointId\": \"https://zzwb.zynews.cn/html/2021-10/14/content_1268411.htm\",\n                    \"checkpointProcessId\": \"null|fcfe8b94-0dda-4948-8b1c-0ebd8c5ae4c2\",\n                    \"lastProcessedRecordType\": {\n                        \"WARC\": \"metadata,WARC_METADATA_PAYLOAD\",\n                        \"WAT\": \"metadata,WAT_METADATA_WARC_METADATA_PAYLOAD\",\n                        \"WET\": \"conversion,WET_CONVERSION_PAYLOAD\"\n                    },\n                    \"offsetBytes\": {\n                        \"WARC\": 5198205879,\n                        \"WAT\": 1269226469,\n                        \"WET\": 333780045\n                    }\n                },\n                \"taskExecutionLogs\": [\n                    {\n                        \"endDatetime\": 1670034196415,\n                        \"startDatetime\": 1670033539581\n                    }\n                ],\n                \"taskId\": \"000189d54a1811a1764cf43b106023d5\",\n                \"taskProgress\": {\n                    \"numRecordsErrored\": 236,\n                    \"numRecordsProcessed\": 39207,\n                    \"numRecordsSkipped\": 0\n                },\n                \"taskStatus\": {\n                    \"taskStatus\": \"COMPLETED\"\n                },\n                \"taskType\": \"READER\",\n                \"tenantId\": \"e7148bad-2415-4a61-9189-7ad14ea5a212\",\n                \"updateDatetime\": 1670035970065,\n                \"userId\": \"aa072857-ef58-4703-97e1-4c1f455e2c0c\"\n            }\n        ]\n    }\n\n

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

Request successfully retrieved the tasks for the dataset. The response body has the tasks, taskLogs and a next token for pagination.

        {\n            \"tasks\": [\n                ...\n            ],\n            \"taskLogs\": [\n                ...\n            ],\n            \"next\": \"...\"\n         }\n\n

404:

The dataset for the tenantId, userId and datasetName was not found in the database. An error code and error message is returned in the response JSON.
\n
```
        {\n          \"statusCode\": \"DATASET_NOT_FOUND\",\n          \"message\": \"Dataset not found in the database.\"\n        }\n\n
```
\n

The dataset has been created but has not started processing yet, as such no tasks have yet been created. Wait for initialization to complete before retrying again.

        {\n          \"statusCode\": \"TASKS_NOT_YET_CREATED\",\n          \"message\": \"datasetStatus is CREATED, tasks have not been created yet. Wait for dataset initialization to complete and retry.\"\n        }\n\n

The dataset exists but hasn't been completely initialized yet, as such no tasks have yet been created. Wait for initialization to complete before retrying again.

        {\n          \"statusCode\": \"TASKS_NOT_YET_CREATED\",\n          \"message\": \"datasetStatus is INITIALIZING, tasks have not been created yet. Wait for dataset initialization to complete and retry.\"\n        }\n\n

500:

An unexpected error has occurred.

                {\n                \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n                \"message\": \"Internal Server Error, please try again later.\"\n                }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
\n

Examples:

Example 1: list all tasks for the logged in user for dataset IndexWebCrawlDataDec2022 - GET www.letsdata.io/api/tasks/list?tenantId=tenantId&userId=userId&&datasetName=IndexWebCrawlDataDec2022
Example 2: Logged in as a TenantAdmin, list all tasks for the dataset IndexWebCrawlDataDec2022 that was created by another user (userId: 078260ed-3124-4de0-8eee-cc5b5025e7ad) in the organization - GET www.letsdata.io/api/tasks/list?tenantId=tenantId&userId=078260ed-3124-4de0-8eee-cc5b5025e7ad&&datasetName=IndexWebCrawlDataDec2022
Example 3: List tasks for dataset IndexWebCrawlDataDec2022 filtering by taskIds - GET www.letsdata.io/api/tasks/list?tenantId=tenantId&userId=userId&&datasetName=IndexWebCrawlDataDec2022&taskIds=01c06add9fb696bf5f69976661cedd57,001c1efa514d2d47ef895c6c717eb06d
Example 4: List tasks for dataset IndexWebCrawlDataDec2022 filtering by taskStatus 'ERROR' - GET www.letsdata.io/api/tasks/list?tenantId=tenantId&userId=userId&&datasetName=IndexWebCrawlDataDec2022&taskStatus=ERROR
Example 5: list tasks for dataset IndexWebCrawlDataDec2022, paginate using the next token from prior call and limit the next page results by specifying limit - GET www.letsdata.io/api/tasks/list?tenantId=tenantId&userId=userId&&datasetName=IndexWebCrawlDataDec2022&limit=100&next=dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw...

Docs:

You can also learn all about Tasks at: https://www.letsdata.io/docs#tasks

\n","urlObject":{"path":["api","tasks","list"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

\n","type":"text/plain"},"key":"userId","value":"userId"},{"description":{"content":"

The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022

\n","type":"text/plain"},"key":"datasetName","value":"TestCommonCrawl"},{"disabled":true,"description":{"content":"

[Optional] Filter the results by returning results whose taskStatus is equal to the given taskStatus, where the taskStatus needs to be from the taskStatus set: CREATED, PROCESSING, COMPLETED, ERROR. &taskStatus=COMPLETED

\n","type":"text/plain"},"key":"taskStatus","value":null},{"disabled":true,"description":{"content":"

[Optional] Filter the results by the tasks whose taskIds are in the given taskIds. This is a comma separated list of taskIds up to a maximum of 100 tasks. For example, &taskIds=01c06add9fb696bf5f69976661cedd57,001c1efa514d2d47ef895c6c717eb06d

\n","type":"text/plain"},"key":"taskIds","value":null},{"disabled":true,"description":{"content":"

The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved.
The records may be a little more than the limit (~<10 or so). User should handle these gracefully.\nRule of thumb in using limits is to treat it as a soft max limit. For example, &limit=100

\n","type":"text/plain"},"key":"limit","value":null},{"disabled":true,"description":{"content":"

[Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved. For example, &next=dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw%2B4MpoRCd%2F2eL3WaI2IHe3%2FbLYH%2F%2FgAYXtGXI01BZ5d5NwdWcVf7o5HGGpbvKibkd0zDfUUiJjI%2FaJQaSb2tM5mwflwszzdHuyNolNNtXwij1TjyGqLny2p0O5PquoYig8iq8YI%3D

\n","type":"text/plain"},"key":"next","value":null}],"variable":[]}},"response":[{"id":"1e1f30e0-f226-4d02-81a4-b94214b6808c","name":"Example - List Dataset Tasks","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/tasks/list?tenantId=tenantId&userId=userId&datasetName=APICreateDatasetExample1","host":["https://www.letsdata.io"],"path":["api","tasks","list"],"query":[{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner."},{"key":"datasetName","value":"APICreateDatasetExample1","description":"The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022"},{"key":"taskStatus","value":"","description":"[Optional] Filter the results by returning results whose taskStatus is equal to the given taskStatus, where the taskStatus needs to be from the taskStatus set: CREATED, PROCESSING, COMPLETED, ERROR. `&taskStatus=COMPLETED`","disabled":true},{"key":"taskIds","value":"","description":"[Optional] Filter the results by the tasks whose taskIds are in the given taskIds. This is a comma separated list of taskIds up to a maximum of 100 tasks. For example, `&taskIds=01c06add9fb696bf5f69976661cedd57,001c1efa514d2d47ef895c6c717eb06d`","disabled":true},{"key":"limit","value":"","description":"[Optional] The limit for the number of results that are to be returned by the command. This is used in conjunction with pagination when large number of records are being retrieved. This is optional and the system does set some meaningful defaults in most APIs. Also, this limit is a hint for the API and the results are not guaranteed to be exactly the same number as the limit. The user needs to handle the following cases when specifying limits:\n - The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved.\n - The records may be a little more than the limit (~<10 or so). User should handle these gracefully.\nRule of thumb in using limits is to treat it as a soft max limit. For example, `&limit=100`","disabled":true},{"key":"next","value":"","description":"[Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved. For example, `&next=dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw%2B4MpoRCd%2F2eL3WaI2IHe3%2FbLYH%2F%2FgAYXtGXI01BZ5d5NwdWcVf7o5HGGpbvKibkd0zDfUUiJjI%2FaJQaSb2tM5mwflwszzdHuyNolNNtXwij1TjyGqLny2p0O5PquoYig8iq8YI%3D`","disabled":true}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 17:20:14 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"5766"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"8ebcb77a-f5ea-40f3-aaa1-a12869534276"},{"key":"x-amz-apigw-id","value":"UbHHYG4moAMEMXw="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65edebc8-6bb50bcb61cfdb023b5ca703"}],"cookie":[],"responseTime":null,"body":"{\n \"next\": null,\n \"tasks\": [\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"dataset\": \"APICreateDatasetExample1\",\n \"datasetId\": \"199acff350c44fd5a693059e22c0f040\",\n \"taskId\": \"1ce7998da2da70266a09440a6da19698\",\n \"taskType\": \"READER\",\n \"readerDefinition\": {\n \"manifestId\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00001.warc.wet.gz\",\n \"readerType\": \"SINGLEFILEREADER\",\n \"fileName\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00001.warc.wet.gz\"\n },\n \"computeDefinition\": {\n \"workerProcessId\": \"2024/03/10/[$LATEST]0f076e8717f74de7a156d2b007ea5061|d7458438-8c59-4e6f-88ed-5843c9f79033\"\n },\n \"taskStatus\": {\n \"taskStatus\": \"PROCESSING\"\n },\n \"taskProgress\": {\n \"numRecordsProcessed\": 2375,\n \"numRecordsErrored\": 0,\n \"numRecordsSkipped\": 0\n },\n \"taskCheckpoint\": {\n \"checkpointProcessId\": \"2024/03/10/[$LATEST]0f076e8717f74de7a156d2b007ea5061|d7458438-8c59-4e6f-88ed-5843c9f79033\",\n \"checkpointId\": \"http://urlmetrics.be/sm/t/\",\n \"checkpointDatetime\": 1710091212962,\n \"offsetBytes\": \"17279269\"\n },\n \"taskExecutionLogs\": [\n {\n \"startDatetime\": 1710091168619,\n \"endDatetime\": null\n }\n ],\n \"createDatetime\": 1710091140405,\n \"updateDatetime\": 1710091212962\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"dataset\": \"APICreateDatasetExample1\",\n \"datasetId\": \"199acff350c44fd5a693059e22c0f040\",\n \"taskId\": \"dd071cdb2eaa3ce6074028dbabe0cd79\",\n \"taskType\": \"READER\",\n \"readerDefinition\": {\n \"manifestId\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00000.warc.wet.gz\",\n \"readerType\": \"SINGLEFILEREADER\",\n \"fileName\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00000.warc.wet.gz\"\n },\n \"computeDefinition\": {\n \"workerProcessId\": \"2024/03/10/[$LATEST]30b0057713044fcb8a165f6637bfcedf|a12be44e-0f03-46da-99ac-de534c0c8f7a\"\n },\n \"taskStatus\": {\n \"taskStatus\": \"PROCESSING\"\n },\n \"taskProgress\": {\n \"numRecordsProcessed\": 2375,\n \"numRecordsErrored\": 0,\n \"numRecordsSkipped\": 0\n },\n \"taskCheckpoint\": {\n \"checkpointProcessId\": \"2024/03/10/[$LATEST]30b0057713044fcb8a165f6637bfcedf|a12be44e-0f03-46da-99ac-de534c0c8f7a\",\n \"checkpointId\": \"http://video.lib.tsinghua.edu.cn/index.php?m=content&c=index&a=lists&header_id=&keyword=&show=&catid=22&yq=&tc=431&yyj=454&yysq=478&kukeother=495&cbsq=502&search_y=0&search_m=0\",\n \"checkpointDatetime\": 1710091213229,\n \"offsetBytes\": \"18521441\"\n },\n \"taskExecutionLogs\": [\n {\n \"startDatetime\": 1710091168534,\n \"endDatetime\": null\n }\n ],\n \"createDatetime\": 1710091140405,\n \"updateDatetime\": 1710091213229\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"dataset\": \"APICreateDatasetExample1\",\n \"datasetId\": \"199acff350c44fd5a693059e22c0f040\",\n \"taskId\": \"f9914a4554e7100bd13a7fc0b03196dc\",\n \"taskType\": \"READER\",\n \"readerDefinition\": {\n \"manifestId\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00002.warc.wet.gz\",\n \"readerType\": \"SINGLEFILEREADER\",\n \"fileName\": \"crawl-data/CC-MAIN-2023-50/segments/1700679099281.67/wet/CC-MAIN-20231128083443-20231128113443-00002.warc.wet.gz\"\n },\n \"computeDefinition\": {\n \"workerProcessId\": \"2024/03/10/[$LATEST]b7f146060e5e437093d693dd2522c35d|f68bcdce-ee25-450a-8f81-a443bb7fcfba\"\n },\n \"taskStatus\": {\n \"taskStatus\": \"PROCESSING\"\n },\n \"taskProgress\": {\n \"numRecordsProcessed\": 2375,\n \"numRecordsErrored\": 0,\n \"numRecordsSkipped\": 0\n },\n \"taskCheckpoint\": {\n \"checkpointProcessId\": \"2024/03/10/[$LATEST]b7f146060e5e437093d693dd2522c35d|f68bcdce-ee25-450a-8f81-a443bb7fcfba\",\n \"checkpointId\": \"http://vesti-sudak.ru/2015/08/pozharnaya-bezopasnost-v-detskix-lageryax/\",\n \"checkpointDatetime\": 1710091213127,\n \"offsetBytes\": \"19136278\"\n },\n \"taskExecutionLogs\": [\n {\n \"startDatetime\": 1710091168716,\n \"endDatetime\": null\n }\n ],\n \"createDatetime\": 1710091140405,\n \"updateDatetime\": 1710091213127\n }\n ],\n \"taskLogs\": [\n {\n \"taskId\": \"f9914a4554e7100bd13a7fc0b03196dc\",\n \"taskStatus\": \"PROCESSING\",\n \"logs\": [\n \"osteKzlmTnUCphgX41LQt80B2LNMLm1wSEd9YzXzjH69NNHdzoSRTQLURS5G%2F57WFttwcNAo7rdIUNMh2KMOXEeqWSLNNwhFFGRD4MdepBmOj1LCfhWQZnB3MfUdx4JfniFd4fYS73823%2B8Ht2JU6IwcQLThLH4KmIMLizrXrfn3ZiS4k2A0jwRoyRMwaWbV2Ajkycd0hIwXlhr1O%2BJaCupjKbWz%2B5Pq5uLl%2BEzThIh8Th0zudpzo1qCDNKjm9djqOxi%2FQJdy3%2BZtPzTrMDqMHOjaIbY1gPsGGAnmn5yIlbuJ939ktC57gEQiq0liPOelhPAKDSMgQeFtRQNmP2DA%2B7vt9z%2FFL5455cm0zMCd%2B%2BqIO9W%2F9zZkpg6pcuMRwMvRL96auIQIufrCuK4FU6p6WCTHAVcgQPD2h%2BTSkmgIrKrHKP3lUOyeAi6yDZjHNRPpKfiJTmzI6UCNx5y%2BaBvmOq5y%2F181FIlhgaDOTEeEipv3X5M7EQAlUE1P3PFnsBjNZm5l6tBRKT4bna3TxZV2g%3D%3D\"\n ]\n },\n {\n \"taskId\": \"dd071cdb2eaa3ce6074028dbabe0cd79\",\n \"taskStatus\": \"PROCESSING\",\n \"logs\": [\n \"osteKzlmTnUCphgX41LQt80B2LNMLm1wSEd9YzXzjH69NNHdzoSRTQLURS5G%2F57WFttwcNAo7rdIUNMh2KMOXEeqWSLNNwhFFGRD4MdepBk6C660jNpJb95vOCvq%2BigQq6wTOukVEo03vgx3%2BKocJ6WXJQl6gIgH7r1xhSV%2FyTUgCukVvBjhrynL6tUFnJ%2BtP3CcfM%2BJUKVQ52Dgt7eP2nDRGnn78iT63EhLTs6jmACR575C4NtPGe8RCQtaC3CfvpYXWW41EKoDxV94NMiaEH5Lro0OCQ4FOaMN2Gq%2FxQ5tFJcnl1ksuzXdCbNcg7j8pwxZgS%2FY08WIe45WqSWQDb8xm%2BFQvAcyweb30rNF0ivSBFXEO5s5%2F6bOwlLEWQys%2FerHEj2gmdpgJXEkqrfa9%2B%2FK%2Bpa2ZyZnVs19mPq9%2B2gOBeceU9V9PamTM30%2B3OQOlx%2F4eAGvKAXdIts0rkD79ZcmaloCpBTiw5UrpfY%2FnWobMPW%2BO6DANZc1S2s78l%2BULguo7jYihsNQS%2FNlsg0c4w%3D%3D\"\n ]\n },\n {\n \"taskId\": \"1ce7998da2da70266a09440a6da19698\",\n \"taskStatus\": \"PROCESSING\",\n \"logs\": [\n \"osteKzlmTnUCphgX41LQt80B2LNMLm1wSEd9YzXzjH69NNHdzoSRTQLURS5G%2F57WFttwcNAo7rdIUNMh2KMOXEeqWSLNNwhFFGRD4MdepBmmq6ZlqP6C0elvx35QOCuvM0LMGnCWDJsVBjQg0yfZAAwHggTU0Gi6UBrltwbUh0V7XhSvG2VHqEy4h6IBGSlFjvoeAfox%2BFC%2FZoQ9ZQjhjXgcY3S3VRTvK8efO0tSPeE9TSunZlzdKRSt1iDPoPND8Jxjivj53RRWzlhhE6Cq%2F%2FFzdww79x0l5kCWEEFQfKBeYh2AZ6jSASbpWkWVF8TAmL6vvL8hUTsmbos9%2B0tpOCodIVhdH6imZr8%2FctRL2Qc4wIq3v%2B8yVOVAAxuZi56j%2FVoQ7Fbzc8kY%2BzuVjlbYg6iIjzWhq9P3TPSdVE8HIU6puXmDcABlzgCLqehmQ%2F%2FLkH3i0CNEsEgsQ32%2Fj2lWR3xkWM5hpeqmFDMuTMmcjIOOV2UMgfP70HIdvrngsxOy9Ffr7kNXNrXI5kEqqgUKqQ%3D%3D\"\n ]\n }\n ]\n}"}],"_postman_id":"2b1cc823-a00b-4878-9b1c-8163f7585782"}],"id":"58c88a75-2a39-4565-838d-a0ce909d1dc7","description":"

The list sub resource has api to list the tasks for a dataset. The datasetName parameter is mandatory and the api supports a few optional filters that can be used to filter the results

\n","_postman_id":"58c88a75-2a39-4565-838d-a0ce909d1dc7"},{"name":"stop","item":[{"name":"Stop Dataset Tasks","id":"25efdf83-5bb0-419a-959b-17f2f25c6d6e","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"body":{"mode":"raw","raw":" {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"APICreateDatasetExample1\",\n \"datasetId\": \"199acff350c44fd5a693059e22c0f040\",\n \"stopTransition\": \"ERROR\"\n }","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/tasks/stop","description":"

tasks/stop POST

A dataset that is being processed can be stopped. When a dataset is stopped its tasks are transitioned to the specified COMPLETE / ERROR state. This can be used to kill running datasets that are not needed anymore, have errors that need to be corrected etc.

Input Parameters:

The POST body for a JSON request has the following schema:

{\n    \"tenantId\": \"the dataset's tenantId\",\n    \"userId\": \"the dataset's userId\",\n    \"datasetName\": \"the datasetName\",\n    \"datasetId\": \"the datasetId\",\n    \"stopTransition\": \"COMPLETE|ERROR - stopped tasks are transitioned to the specified COMPLETE / ERROR state\"\n}\n\n

Here are the details for the JSON request schema:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For Example, --userId 078260ed-3124-4de0-8eee-cc5b5025e7ad (TODO - this can be optional, API gets it from token)
datasetName: The dataset name for the dataset that the user wants to run the command for.
datasetId: The datasetId for the dataset the user wants to run the command for. The datasetId can be retrieved from the dataset JSON returned by the View Dataset command (GET /dataset)
stopTransition: The end state of the stopped tasks. When a dataset is stopped, the stopped tasks can be transitioned to either COMPLETE or ERROR state. Supported values are: [COMPLETE,ERROR]

Examples:

For example, a POST request to the tasks/stop resource with the following body would stop the tasks for the dataset named IndexWebCrawlDataDec2022 and datasetId 27251ad51f2addb2e3952cbbe12d97dc belonging to the tenant (tenantId: d5feaf90-71a9-41ee-b1b9-35e4242c3155) and user (userId: accb3567-2b6e-41ae-b00d-6ce1f9a58d94) and transition the tasks to ERROR state.

    {\n      \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n      \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n      \"datasetName\": \"IndexWebCrawlDataDec2022\",\n      \"datasetId\": \"27251ad51f2addb2e3952cbbe12d97dc\",\n      \"stopTransition\": \"ERROR\"\n    }\n\n

Output Parameters:

    {\n        \"statusCode\": \"SUCCESS|ERROR|NOT_ALLOWED_AT_THIS_TIME|NOT_FOUND\",\n        \"message\": \"String\"\n    }\n\n

statusCode: StatusCode of the request - this can be either SUCCESS, ERROR or NOT_ALLOWED_AT_THIS_TIME. In each of these cases, the Message string has additional details about the status. For example, if a dataset status is not currently PROCESSING and you attempt to stop, the call will fail with the statusCode NOT_ALLOWED_AT_THIS_TIME. Status code ERROR is returned for errors that may be transient. Do check the latest dataset status and retry the command.
message: The error / success message that has the details about the status of the request.

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

Request was successfully enqueued

    {\n        \"statusCode\": \"SUCCESS\",\n        \"message\": \"The dataset stop request has successfully been enqueued.\"\n    }\n\n

400:

Request is not allowed at this time since the datasetStatus is different from PROCESSING. tasks/stop request is allowed only in PROCESSING status.

    {\n        \"statusCode\": \"NOT_ALLOWED_AT_THIS_TIME\",\n        \"message\": \"The dataset status should be PROCESSING when requesting to stop a dataset.\"\n    }\n\n

404:

The dataset for the tenantId, userId and datasetName was not found in the database.

    {\n        \"statusCode\": \"NOT_FOUND\",\n        \"message\": \"The dataset was not found in the database\"\n    }\n\n

500:

Request was enqueued earlier and failed with an error

    {\n        \"statusCode\": \"ERROR\",\n        \"message\": \"The dataset stop request threw an unknown error. Please try again.\"\n    }\n\n

An unexpected error has occurred.

    {\n        \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n        \"message\": \"Internal Server Error, please try again later.\"\n    }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
\n

View the latest status of the dataset by issuing a GET on the dataset resource. A dataset that is stopping shows a transient STOPPING_COMPLETE / STOPPING_ERROR state. A stopped dataset transitioned to datasetStatus 'COMPLETED' / ERRORED.

Details:

Datasets that are processing can have their tasks stopped by using the 'datasets stop' command. Datasets can be stopped for a few different reasons:

dataset processing is completed and there is no additional work to be done. For example, tasks are reading from SQS in continuous mode and the queue has no more data.
dataset is processing with errors / failures that need to be corrected. The dataset tasks can be stopped in this case, errors and failures corrected by updating dataset code / compute and then redriving the tasks.
dataset is processing but is not needed anymore. The dataset tasks can be stopped in this case so they do not process any additional data and accrue costs.

The stopTransition status determines whether the PROCESSING tasks would transition COMPLETE state or to an ERROR state. When deciding the stopTransition, do note that the COMPLETED tasks cannot be redriven - so if the tasks need to be redriven after correcting errors, use the ERROR stopTransition.

// TODO We had implemented task stop in a hurry to have the feature completeness where we wanted to emergency stop tasks - for example in cases where a running task might be causing issues. The control of the task should rather be a workflow similar to the dataset update workflows where we dedupe requests and execute an update workflow (a stop workflow in this case) and validate each state to completion. We'll rework the implementation in a future release.

Docs

You can learn about Datasets at: https://www.letsdata.io/docs#datasets

\n","urlObject":{"path":["api","tasks","stop"],"host":["https://www.letsdata.io"],"query":[],"variable":[]}},"response":[{"id":"5e1d1a59-6460-4bfd-80f7-3645004626f1","name":"Example -Stop Dataset Tasks","originalRequest":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"body":{"mode":"raw","raw":" {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"APICreateDatasetExample1\",\n \"datasetId\": \"199acff350c44fd5a693059e22c0f040\",\n \"stopTransition\": \"ERROR\"\n }","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/tasks/stop"},"status":"Bad Request","code":400,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:33:41 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"128"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"d371fc9f-481e-476a-afd8-812a875b6805"},{"key":"x-amz-apigw-id","value":"UbjdAGelIAMEjOA="},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee191f-3a6e44bb576f0d1110d571e9"}],"cookie":[],"responseTime":null,"body":"{\n \"statusCode\": \"NOT_ALLOWED_AT_THIS_TIME\",\n \"message\": \"The dataset status should be PROCESSING when requesting to stop a dataset.\"\n}"}],"_postman_id":"25efdf83-5bb0-419a-959b-17f2f25c6d6e"}],"id":"45929406-fe97-4fa6-ac6b-cd4017057fa0","description":"

The `stop` sub resource has api to stop a dataset's currently running tasks

\n","_postman_id":"45929406-fe97-4fa6-ac6b-cd4017057fa0"}],"id":"36484879-1050-42fb-8c5f-a8afb700c3ee","description":"

Tasks are the system's representation of a work item that is executed by the compute engine (e.g. AWS Lambda). When a task executes, it reads from the read destination, calls the user handlers to create a document that it then writes to the write destination. During this execution, a task emits metrics, logs and errors records. Each of these is treated as its own resource in the CLI and these resources tie in together with tasks (taskId). As of now, the `tasks` resource defines a list api to list the tasks for a dataset and a redrive api to rerun errored tasks.

\n","_postman_id":"36484879-1050-42fb-8c5f-a8afb700c3ee"},{"name":"errors","item":[{"name":"list","item":[{"name":"List Errors","id":"7666f09f-10f3-49c7-9bb8-57e1ed72cdb5","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/errors/list?tenantId=tenantId&userId=userId&datasetName=CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20&limit=1&next=zZjrcnoBZRyT7b77AUd%2F%2B3h7mgfpaROoCfTisDnsVvGrd4vlsTJxTJnq1lDHYHoKp6jDsHFOvCnoFuSrJ3vGHAxSy7Mf4JZNwEohzDCVOo4%3D","description":"

errors/list - GET

The list of the errors for task(s) are returned by the errors/list GET API. The API supports optional taskStatus and taskIds filters and returns a list of the error files, and an optional next token to paginate the next page.

Input Parameters:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For example, &userId=078260ed-3124-4de0-8eee-cc5b5025e7ad
datasetName: The dataset name for the dataset that the user wants to run the command for. For example, &datasetName=IndexWebCrawlDataDec2022
taskStatus: [Optional] Filter the results by returning results whose taskStatus is equal to the given taskStatus, where the taskStatus needs to be from the taskStatus set: CREATED, PROCESSING, COMPLETED, ERROR. &taskStatus=COMPLETED
taskIds: [Optional] Filter the results by the tasks whose taskIds are in the given taskIds. This is a comma separated list of taskIds up to a maximum of 100 tasks. For example, &taskIds=01c06add9fb696bf5f69976661cedd57,001c1efa514d2d47ef895c6c717eb06d
limit: [Optional] The limit for the number of results that are to be returned by the command. This is used in conjunction with pagination when large number of records are being retrieved. This is optional and the system does set some meaningful defaults in most APIs. Also, this limit is a hint for the API and the results are not guaranteed to be exactly the same number as the limit. The user needs to handle the following cases when specifying limits:
- The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved.
- The records may be a little more than the limit (~<10 or so). User should handle these gracefully.
  Rule of thumb in using limits is to treat it as a soft max limit. For example, &limit=100
\n
next: [Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved. For example, &next=dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw+4MpoRCd/2eL3WaI2IHe3/bLYH//gAYXtGXI01BZ5d5NwdWcVf7o5HGGpbvKibkd0zDfUUiJjI/aJQaSb2tM5mwflwszzdHuyNolNNtXwij1TjyGqLny2p0O5PquoYig8iq8YI=

Output Parameters:

The output is a JSON map that has the following sections:

    {\n        \"errors\": [\n            {\n                ...\n            },\n            {\n                ...\n            },\n            ...\n        ],\n        \"next\": \"String\"\n    }\n\n

errors: This is the list of task error filenames and error metadata that are returned by the API. These have details about the taskId, the file offsets, the filename and the number of errors in the file. Here is an example errors json:

\"errors\": [\n  {\n      \"taskId\": \"00009b45de184a92dde4b907b216fcde\",\n      \"taskStatus\": \"COMPLETED\",\n      \"numberOfErrors\": 8,\n      \"errors\": [\n          {\n              \"filename\": \"00009b45de184a92dde4b907b216fcde_892709352_3501890178_1670061736233_6.gz\",\n              \"maxEndOffset\": 3501890178,\n              \"minStartOffset\": 892709352,\n              \"numberOfErrors\": 6,\n              \"taskId\": \"00009b45de184a92dde4b907b216fcde\",\n              \"timestamp\": 1670061736233\n          },\n          {\n              \"filename\": \"00009b45de184a92dde4b907b216fcde_916460583_3582601612_1670061739347_2.gz\",\n              \"maxEndOffset\": 3582601612,\n              \"minStartOffset\": 916460583,\n              \"numberOfErrors\": 2,\n              \"taskId\": \"00009b45de184a92dde4b907b216fcde\",\n              \"timestamp\": 1670061739347\n          }\n      ]\n  },\n  ...\n]\n\n

next: [Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved.
\n

Actual Example Output:

Here is an actual example output for the command:

    {\n        \"errors\": [\n            {\n                \"errors\": [\n                    {\n                        \"filename\": \"00009b45de184a92dde4b907b216fcde_892709352_3501890178_1670061736233_6.gz\",\n                        \"maxEndOffset\": 3501890178,\n                        \"minStartOffset\": 892709352,\n                        \"numberOfErrors\": 6,\n                        \"taskId\": \"00009b45de184a92dde4b907b216fcde\",\n                        \"timestamp\": 1670061736233\n                    },\n                    {\n                        \"filename\": \"00009b45de184a92dde4b907b216fcde_916460583_3582601612_1670061739347_2.gz\",\n                        \"maxEndOffset\": 3582601612,\n                        \"minStartOffset\": 916460583,\n                        \"numberOfErrors\": 2,\n                        \"taskId\": \"00009b45de184a92dde4b907b216fcde\",\n                        \"timestamp\": 1670061739347\n                    }\n                ],\n                \"numberOfErrors\": 8,\n                \"taskId\": \"00009b45de184a92dde4b907b216fcde\",\n                \"taskStatus\": \"COMPLETED\"\n            },\n            {\n                \"errors\": [\n                    {\n                        \"filename\": \"000074c042092ef7c31316e70b5570d7_1006411567_4040863826_1670072698199_8.gz\",\n                        \"maxEndOffset\": 4040863826,\n                        \"minStartOffset\": 1006411567,\n                        \"numberOfErrors\": 8,\n                        \"taskId\": \"000074c042092ef7c31316e70b5570d7\",\n                        \"timestamp\": 1670072698199\n                    }\n                ],\n                \"numberOfErrors\": 8,\n                \"taskId\": \"000074c042092ef7c31316e70b5570d7\",\n                \"taskStatus\": \"COMPLETED\"\n            },\n            {\n                \"errors\": [\n                    {\n                        \"filename\": \"000189d54a1811a1764cf43b106023d5_1005733344_3985152907_1670034075485_4.gz\",\n                        \"maxEndOffset\": 3985152907,\n                        \"minStartOffset\": 1005733344,\n                        \"numberOfErrors\": 4,\n                        \"taskId\": \"000189d54a1811a1764cf43b106023d5\",\n                        \"timestamp\": 1670034075485\n                    },\n                    {\n                        \"filename\": \"000189d54a1811a1764cf43b106023d5_1034206841_4164716934_1670034081848_6.gz\",\n                        \"maxEndOffset\": 4164716934,\n                        \"minStartOffset\": 1034206841,\n                        \"numberOfErrors\": 6,\n                        \"taskId\": \"000189d54a1811a1764cf43b106023d5\",\n                        \"timestamp\": 1670034081848\n                    }\n                ],\n                \"numberOfErrors\": 10,\n                \"taskId\": \"000189d54a1811a1764cf43b106023d5\",\n                \"taskStatus\": \"COMPLETED\"\n            }\n        ],\n        \"next\": \"dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw+4MpoRCd/2eL3WaI2IHe3/bLYH//gAYXtGXI01BZ5d5NwdWcZIyqNhdiYhwUxmh/cqdf50XIlDkVE8RJa7MKMfJWFLXYHecd/lVNcXAAVp5QceAdKSK4toICTCi1ZYVm7BJVag=\"\n    }\n\n

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

Request successfully retrieved the tasks for the dataset. The response body has the tasks, taskLogs and a next token for pagination.

  {\n      \"errors\": [\n          {\n              ...\n          },\n          {\n              ...\n          },\n          ...\n      ],\n      \"next\": \"String\"\n  }\n\n

404:

The dataset for the tenantId, userId and datasetName was not found in the database. An error code and error message is returned in the response JSON.
\n
```
    {\n      \"statusCode\": \"DATASET_NOT_FOUND\",\n      \"message\": \"Dataset not found in the database.\"\n    }\n\n
```
\n

The dataset has been deleted. Any task databases should have been deleted as well.

    {\n      \"statusCode\": \"DELETED\",\n      \"message\": \"datasetStatus is DELETED.\"\n    }\n\n

The dataset has been created but has not started processing yet, as such no error files have yet been created. Wait for initialization to complete before retrying again.

    {\n      \"statusCode\": \"TASKS_NOT_YET_CREATED\",\n      \"message\": \"datasetStatus is CREATED, tasks have not been created yet, hence there are no errors. Wait for dataset initialization to complete and retry.\"\n    }\n\n

The dataset exists but hasn't been completely initialized yet, as such no error files have yet been created. Wait for initialization to complete before retrying again.

    {\n      \"statusCode\": \"TASKS_NOT_YET_CREATED\",\n      \"message\": \"datasetStatus is INITIALIZING, tasks have not been created yet, hence there are no errors. Wait for dataset initialization to complete and retry.\"\n    }\n\n

500:

An unexpected error has occurred.

            {\n            \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n            \"message\": \"Internal Server Error, please try again later.\"\n            }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
\n

Examples:

Example 1: list a dataset's task's errors, optionally limit using limit and paginate using next tokens

  GET www.letsdata.io/api/errors/list?tenantId=tenantId&userId=userId&datasetName=IndexWebCrawlDataDec2022\n  GET www.letsdata.io/api/errors/list?tenantId=tenantId&userId=userId&datasetName=IndexWebCrawlDataDec2022 \\\n          &next=dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw+4MpoRCd/2eL3WaI2IHe3/bLYH//gAYXtGXI01BZ5d5NwdWcZIyqNhdiYhwUxmh/cqdf50XIlDkVE8RJa7MKMfJWFLXYHecd/lVNcXAAVp5QceAdKSK4toICTCi1ZYVm7BJVag=\n  GET www.letsdata.io/api/errors/list?tenantId=tenantId&userId=userId&datasetName=IndexWebCrawlDataDec2022 \\\n          &limit=100\n  GET www.letsdata.io/api/errors/list?tenantId=tenantId&userId=userId&datasetName=IndexWebCrawlDataDec2022 \\\n          &limit=100 \\\n          &next=dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw+4MpoRCd/2eL3WaI2IHe3/bLYH//gAYXtGXI01BZ5d5NwdWcZIyqNhdiYhwUxmh/cqdf50XIlDkVE8RJa7MKMfJWFLXYHecd/lVNcXAAVp5QceAdKSK4toICTCi1ZYVm7BJVag=\n\n

Example 2: list a dataset's task's errors by tasks ids and filter by task status

  GET www.letsdata.io/api/errors/list?tenantId=tenantId&userId=userId&datasetName=IndexWebCrawlDataDec2022 \\\n          &taskIds=01c06add9fb696bf5f69976661cedd57,001c1efa514d2d47ef895c6c717eb06d\n  GET www.letsdata.io/api/errors/list?tenantId=tenantId&userId=userId&datasetName=IndexWebCrawlDataDec2022 \\\n          &taskIds=01c06add9fb696bf5f69976661cedd57,001c1efa514d2d47ef895c6c717eb06d \\\n          &taskStatus=ERROR\n\n

Example 3: list a dataset's task's errors, filtering by task status, paginate using next tokens and limit results by specifying limit

  GET www.letsdata.io/api/errors/list?tenantId=tenantId&userId=userId&datasetName=IndexWebCrawlDataDec2022 \\\n          &taskStatus=ERROR\n  GET www.letsdata.io/api/errors/list?tenantId=tenantId&userId=userId&datasetName=IndexWebCrawlDataDec2022 \\\n          &taskStatus=ERROR \\\n          &next=dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw+4MpoRCd/2eL3WaI2IHe3/bLYH//gAYXtGXI01BZ5d5NwdWcZIyqNhdiYhwUxmh/cqdf50XIlDkVE8RJa7MKMfJWFLXYHecd/lVNcXAAVp5QceAdKSK4toICTCi1ZYVm7BJVag=\n  GET www.letsdata.io/api/errors/list?tenantId=tenantId&userId=userId&datasetName=IndexWebCrawlDataDec2022 \\\n          &taskStatus=ERROR \\\n          &limit=100 \\\n          &next=dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw+4MpoRCd/2eL3WaI2IHe3/bLYH//gAYXtGXI01BZ5d5NwdWcZIyqNhdiYhwUxmh/cqdf50XIlDkVE8RJa7MKMfJWFLXYHecd/lVNcXAAVp5QceAdKSK4toICTCi1ZYVm7BJVag=\n\n

Example 4: Logged in as a TenantAdmin, list all errors for the dataset IndexWebCrawlDataDec2022 that was created by another user (userId: 078260ed-3124-4de0-8eee-cc5b5025e7ad) in the organization

  $ > letsdata errors list --datasetName IndexWebCrawlDataDec2022 --userId '078260ed-3124-4de0-8eee-cc5b5025e7ad'\n\n

  GET www.letsdata.io/api/errors/list?tenantId=tenantId&userId=078260ed-3124-4de0-8eee-cc5b5025e7ad&datasetName=IndexWebCrawlDataDec2022\n\n

Docs:

You can also learn all about Error Handling at: https://www.letsdata.io/docs#errorhandling

\n","urlObject":{"path":["api","errors","list"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

\n","type":"text/plain"},"key":"userId","value":"userId"},{"description":{"content":"

The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022

\n","type":"text/plain"},"key":"datasetName","value":"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20"},{"disabled":true,"description":{"content":"

[Optional] Filter the results by the tasks whose taskIds are in the given taskIds. This is a list of taskIds as a JSON string list up to a maximum of 100 tasks. For example, &taskIds=[\"01c06add9fb696bf5f69976661cedd57\",\"001c1efa514d2d47ef895c6c717eb06d\"]

\n","type":"text/plain"},"key":"taskIds","value":"[\"shardId-000000000000\",\"shardId-000000000002\"]"},{"disabled":true,"description":{"content":"

\n","type":"text/plain"},"key":"taskStatus","value":"ERROR"},{"description":{"content":"

The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved.
The records may be a little more than the limit (~<10 or so). User should handle these gracefully.\n Rule of thumb in using limits is to treat it as a soft max limit. For example, &limit=100

\n","type":"text/plain"},"key":"limit","value":"1"},{"description":{"content":"

\n","type":"text/plain"},"key":"next","value":"zZjrcnoBZRyT7b77AUd%2F%2B3h7mgfpaROoCfTisDnsVvGrd4vlsTJxTJnq1lDHYHoKp6jDsHFOvCnoFuSrJ3vGHAxSy7Mf4JZNwEohzDCVOo4%3D"}],"variable":[]}},"response":[{"id":"44823bb4-3ad8-4049-b81c-8d1bc1c0b083","name":"Example - List Errors","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/errors/list?tenantId=tenantId&userId=userId&datasetName=CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20","host":["https://www.letsdata.io"],"path":["api","errors","list"],"query":[{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner."},{"key":"datasetName","value":"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20","description":"The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022"},{"key":"taskIds","value":"[\"shardId-000000000000\",\"shardId-000000000002\"]","description":"[Optional] Filter the results by the tasks whose taskIds are in the given taskIds. This is a list of taskIds as a JSON string list up to a maximum of 100 tasks. For example, `&taskIds=[\"01c06add9fb696bf5f69976661cedd57\",\"001c1efa514d2d47ef895c6c717eb06d\"]`","disabled":true},{"key":"taskStatus","value":"ERROR","description":"[Optional] Filter the results by returning results whose taskStatus is equal to the given taskStatus, where the taskStatus needs to be from the taskStatus set: CREATED, PROCESSING, COMPLETED, ERROR. `&taskStatus=COMPLETED`","disabled":true},{"key":"limit","value":"1","description":"[Optional] The limit for the number of results that are to be returned by the command. This is used in conjunction with pagination when large number of records are being retrieved. This is optional and the system does set some meaningful defaults in most APIs. Also, this limit is a hint for the API and the results are not guaranteed to be exactly the same number as the limit. The user needs to handle the following cases when specifying limits:\n - The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved.\n - The records may be a little more than the limit (~<10 or so). User should handle these gracefully.\n Rule of thumb in using limits is to treat it as a soft max limit. For example, `&limit=100`","disabled":true},{"key":"next","value":"zZjrcnoBZRyT7b77AUd%2F%2B3h7mgfpaROoCfTisDnsVvGrd4vlsTJxTJnq1lDHYHoKp6jDsHFOvCnoFuSrJ3vGHAxSy7Mf4JZNwEohzDCVOo4%3D","description":"[Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved. For example, `&next=dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw%2B4MpoRCd%2F2eL3WaI2IHe3%2FbLYH%2F%2FgAYXtGXI01BZ5d5NwdWcVf7o5HGGpbvKibkd0zDfUUiJjI%2FaJQaSb2tM5mwflwszzdHuyNolNNtXwij1TjyGqLny2p0O5PquoYig8iq8YI%3D`","disabled":true}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:15:36 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"683"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"0c5624d4-7dd4-47e5-b482-6756cc4838c5"},{"key":"x-amz-apigw-id","value":"Ubg0XGxkIAMEr4w="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee14e8-6af7e06d3260eee41564784b"}],"cookie":[],"responseTime":null,"body":"{\n \"next\": null,\n \"errors\": [\n {\n \"taskId\": \"shardId-000000000002\",\n \"taskStatus\": \"ERROR\",\n \"errors\": [],\n \"numberOfErrors\": null\n },\n {\n \"taskId\": \"shardId-000000000001\",\n \"taskStatus\": \"ERROR\",\n \"errors\": [],\n \"numberOfErrors\": null\n },\n {\n \"taskId\": \"shardId-000000000000\",\n \"taskStatus\": \"ERROR\",\n \"errors\": [\n {\n \"minStartOffset\": \"49647303705582102337259106459538383112783566454206234626\",\n \"filename\": \"shardId-000000000000_49647303705582102337259106459538383112783566454206234626_49647303705582102337259106459539592038603181083380940802_1702428589100_1.gz\",\n \"maxEndOffset\": \"49647303705582102337259106459539592038603181083380940802\",\n \"taskId\": \"shardId-000000000000\",\n \"timestamp\": 1702428589100,\n \"numberOfErrors\": 1\n }\n ],\n \"numberOfErrors\": 1\n }\n ]\n}"}],"_postman_id":"7666f09f-10f3-49c7-9bb8-57e1ed72cdb5"}],"id":"bd74e380-9a2d-4806-a655-41f02c9c0c17","description":"

The list sub resource has api to list the errors for a dataset's task(s)

\n","_postman_id":"bd74e380-9a2d-4806-a655-41f02c9c0c17"},{"name":"View Error","id":"eb0e9e45-db45-4dd3-8547-db396c9d352d","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/errors?tenantId=tenantId&userId=userId&datasetName=CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20&filename=shardId-000000000000_49647303705582102337259106459538383112783566454206234626_49647303705582102337259106459539592038603181083380940802_1702428589100_1.gz","description":"

errors GET

Details about error records for a task can be viewed by issuing a GET on the errors resource. These return the contents of the error record file which may have one or more error records.

Input Parameters:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For Example, --userId 078260ed-3124-4de0-8eee-cc5b5025e7ad (TODO - this can be optional, API gets it from token)
datasetName: The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022
filename: The error filename. For example, 00009b45de184a92dde4b907b216fcde_892709352_3501890178_1670061736233_6.gz. (The errors/list GET api can be used to list the error files for a task)

Output Parameters:

The output is a JSON map that has the following sections:

    {\n        \"connectorDestination\": \"String\",\n        \"connectorType\": \"String\",\n        \"dataset\": \"String\",\n        \"errorCount\": \"Long\",\n        \"errors\": [\n            {\n                error doc\n            },\n            {\n                error doc\n            },\n            ...\n        ],\n        \"id\": \"String\",\n        \"objectKey\": \"String\",\n        \"taskId\": \"String\"\n    }\n\n

connectorDestination: The error connector destination
\n
connectorType: The error connector type - the error connector is a special write connector so this is set to WRITE as of now
\n
dataset: The dataset name for the error file
\n
errorCount: The number of error documents in the file
\n
id: The id of the error document
\n
objectKey: the s3 error doc object key
\n
taskId: the taskId of the task whose data we want returned.
\n

errors: The list of error documents - these are emitted by the user data handlers using the error doc interface. The ErrorDoc is created by #Let's Data using the user data handler's return docs. Details about the error Doc interface can be found at https://www.letsdata.io/docs/sdk-interface/#errorDocInterfaceDocsContainer). Here is a schema for the error doc:

    {\n        \"DocumentId\": \"String\",\n        \"DocumentMetadata\": {\n            user data handler's error doc's document metadata map\n        },\n        \"RecordType\": {\n            user data handler's error doc's recordType\n        },\n        \"StartOffsetMap\": {\n            \"fileType1\" : \"Long - offsetBytes into the fileType1 to the start of the record\",\n            \"fileType2\" : \"Long - offsetBytes into the fileType2 to the start of the record\",\n            \"fileType3\" : \"Long - offsetBytes into the fileType3 to the start of the record\"\n        },\n        \"EndOffsetMap\": {\n            \"fileType1\" : \"Long - offsetBytes into the fileType1 to the end of the record\",\n            \"fileType2\" : \"Long - offsetBytes into the fileType2 to the end of the record\",\n            \"fileType3\" : \"Long - offsetBytes into the fileType3 to the end of the record\"\n        },\n        \"ErrorMessage\": \"String\".\n        \"Contents\": \"String - the serialized error doc - max allowed length is 4KB (we truncate any content after 4KB)\"\n    }\n\n

Actual Example Output:

Here is an actual example output for the command:

    {\n        \"connectorDestination\": \"S3\",\n        \"connectorType\": \"WRITE\",\n        \"dataset\": \"IndexWebCrawlDataDec2022\",\n        \"errorCount\": 6,\n        \"errors\": [\n            {\n                \"Contents\": \"{\\\"commonCrawlFileType\\\":\\\"WAT\\\",\\\"protocol\\\":\\\"WARC\\\",\\\"version\\\":1.0,\\\"recordType\\\":\\\"metadata,WAT_METADATA_WARC_RESPONSE_PAYLOAD\\\",\\\"date\\\":1657368292000,\\\"recordId\\\":\\\"<urn:uuid:270f4f71-480e-476f-a875-06dc6187a4a9>\\\",\\\"targetUri\\\":\\\"https://www.cooltura.mk/kulturni_nastani/literatura/kavadarecki-recnik/\\\",\\\"contentType\\\":\\\"APPLICATION_JSON\\\",\\\"contentLength\\\":1998,\\\"warcDoc\\\":{\\\"documentRecordTypes\\\":\\\"WAT_METADATA_WARC_RESPONSE_PAYLOAD\\\",\\\"docValue\\\":\\\"exception in reading WAT record from JSON: {\\\\\\\"Container\\\\\\\":{\\\\\\\"Filename\\\\\\\":\\\\\\\"CC-MAIN-20220628081102-20220628111102-00329.warc.gz\\\\\\\",\\\\\\\"Compressed\\\\\\\":true,\\\\\\\"Offset\\\\\\\":\\\\\\\"790224563\\\\\\\",\\\\\\\"Gzip-Metadata\\\\\\\":{\\\\\\\"Deflate-Length\\\\\\\":\\\\\\\"1242\\\\\\\",\\\\\\\"Header-Length\\\\\\\":\\\\\\\"10\\\\\\\",\\\\\\\"Footer-Length\\\\\\\":\\\\\\\"8\\\\\\\",\\\\\\\"Inflated-CRC\\\\\\\":\\\\\\\"782013514\\\\\\\",\\\\\\\"Inflated-Length\\\\\\\":\\\\\\\"2360\\\\\\\"}},\\\\\\\"Envelope\\\\\\\":{\\\\\\\"Payload-Metadata\\\\\\\":{\\\\\\\"Actual-Content-Type\\\\\\\":\\\\\\\"application/http; msgtype=response\\\\\\\",\\\\\\\"HTTP-Response-Metadata\\\\\\\":{\\\\\\\"Response-Message\\\\\\\":{\\\\\\\"Status\\\\\\\":\\\\\\\"200\\\\\\\",\\\\\\\"Version\\\\\\\":\\\\\\\"HTTP/1.1\\\\\\\",\\\\\\\"Reason\\\\\\\":\\\\\\\"OK\\\\\\\"},\\\\\\\"Headers-Length\\\\\\\":\\\\\\\"372\\\\\\\",\\\\\\\"Headers\\\\\\\":{\\\\\\\"Date\\\\\\\":\\\\\\\"Tue, 28 Jun 2022 08:49:57 GMT\\\\\\\",\\\\\\\"Content-Type\\\\\\\":\\\\\\\"text/html\\\\\\\",\\\\\\\"X-Crawler-Transfer-Encoding\\\\\\\":\\\\\\\"chunked\\\\\\\",\\\\\\\"Connection\\\\\\\":\\\\\\\"close\\\\\\\",\\\\\\\"Server\\\\\\\":\\\\\\\"imunify360-webshield/1.18\\\\\\\",\\\\\\\"Last-Modified\\\\\\\":\\\\\\\"Tuesday, 28-Jun-2022 08:49:57 GMT\\\\\\\",\\\\\\\"Cache-Control\\\\\\\":\\\\\\\"private, no-store, no-cache, must-revalidate, proxy-revalidate, max-age=0, s-maxage=0\\\\\\\",\\\\\\\"cf-edge-cache\\\\\\\":\\\\\\\"no-cache\\\\\\\",\\\\\\\"Content-Length\\\\\\\":\\\\\\\"1364\\\\\\\"},\\\\\\\"HTML-Metadata\\\\\\\":{\\\\\\\"Head\\\\\\\":{\\\\\\\"Metas\\\\\\\":[{\\\\\\\"name\\\\\\\":\\\\\\\"robots\\\\\\\",\\\\\\\"content\\\\\\\":\\\\\\\"noindex, nofollow\\\\\\\"}],\\\\\\\"Title\\\\\\\":\\\\\\\"One moment, please...\\\\\\\"},\\\\\\\"Links\\\\\\\":[{\\\\\\\"path\\\\\\\":\\\\\\\"FORM@/action\\\\\\\",\\\\\\\"url\\\\\\\":\\\\\\\"/z0f76a1d14fd21a8fb5fd0d03e0fdc3d3cedae52f\\\\\\\",\\\\\\\"method\\\\\\\":\\\\\\\"get\\\\\\\"}]},\\\\\\\"Entity-Length\\\\\\\":\\\\\\\"1364\\\\\\\",\\\\\\\"Entity-Digest\\\\\\\":\\\\\\\"sha1:OTROA7V3PRCXGROIHTBYKNTEF5VKRBCT\\\\\\\",\\\\\\\"Entity-Trailing-Slop-Length\\\\\\\":\\\\\\\"0\\\\\\\"},\\\\\\\"Actual-Content-Length\\\\\\\":\\\\\\\"1736\\\\\\\",\\\\\\\"Trailing-Slop-Length\\\\\\\":\\\\\\\"4\\\\\\\",\\\\\\\"Block-Digest\\\\\\\":\\\\\\\"sha1:NECKA4S6NF6ZMK2OJXS7BNNT7WURZ2J4\\\\\\\"},\\\\\\\"Format\\\\\\\":\\\\\\\"WARC/1.0\\\\\\\",\\\\\\\"WARC-Header-Length\\\\\\\":\\\\\\\"620\\\\\\\",\\\\\\\"WARC-Header-Metadata\\\\\\\":{\\\\\\\"WARC-Type\\\\\\\":\\\\\\\"response\\\\\\\",\\\\\\\"WARC-Date\\\\\\\":\\\\\\\"2022-06-28T08:49:57Z\\\\\\\",\\\\\\\"WARC-Record-ID\\\\\\\":\\\\\\\"<urn:uuid:f054a31e-d5aa-42a8-92e3-40acecd9e820>\\\\\\\",\\\\\\\"Content-Length\\\\\\\":\\\\\\\"1736\\\\\\\",\\\\\\\"Content-Type\\\\\\\":\\\\\\\"application/http; msgtype=response\\\\\\\",\\\\\\\"WARC-Warcinfo-ID\\\\\\\":\\\\\\\"<urn:uuid:6b3e3709-13cb-43f7-836e-323ea880ea6a>\\\\\\\",\\\\\\\"WARC-Concurrent-To\\\\\\\":\\\\\\\"<urn:uuid:ab06c1a0-ebaa-414c-b213-995a390eb9f1>\\\\\\\",\\\\\\\"WARC-IP-Address\\\\\\\":\\\\\\\"91.121.63.143\\\\\\\",\\\\\\\"WARC-Target-URI\\\\\\\":\\\\\\\"https://www.cooltura.mk/kulturni_nastani/literatura/kavadarecki-recnik/\\\\\\\",\\\\\\\"WARC-Payload-Digest\\\\\\\":\\\\\\\"sha1:OTROA7V3PRCXGROIHTBYKNTEF5VKRBCT\\\\\\\",\\\\\\\"WARC-Block-Digest\\\\\\\":\\\\\\\"sha1:NECKA4S6NF6ZMK2OJXS7BNNT7WURZ2J4\\\\\\\",\\\\\\\"WARC-Identified-Payload-Type\\\\\\\":\\\\\\\"text/html\\\\\\\"}}}\\\",\\\"exception\\\":{\\\"cause\\\":{\\\"cause\\\":{\\\"cause\\\":{\\\"cause\\\":{\\\"cause\\\":null,\\\"stackTrace\\\":[{\\\"methodName\\\":\\\"parse\\\",\\\"fileName\\\":\\\"DateFormat.java\\\",\\\"lineNumber\\\":366,\\\"className\\\":\\\"java.text.DateFormat\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"getDateFromDateString\\\",\\\"fileName\\\":\\\"DateUtils.java\\\",\\\"lineNumber\\\":38,\\\"className\\\":\\\"com.resonance.commoncrawl.util.DateUtils\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"setHttpHeadersFromMap\\\",\\\"fileName\\\":\\\"WarcHttpResponseDoc.java\\\",\\\"lineNumber\\\":508,\\\"className\\\":\\\"com.resonance.commoncrawl.model.filerecords.docs.WarcHttpResponseDoc\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"<init>\\\",\\\"fileName\\\":\\\"WarcResponsePayloadMetadata.java\\\",\\\"lineNumber\\\":406,\\\"className\\\":\\\"com.resonance.commoncrawl.model.filerecords.docs.watmetadata.envelope.payloadmetadata.WarcResponsePayloadMetadata$ResponsePayloadHttpMetadata\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"newInstance\\\",\\\"fileName\\\":null,\\\"lineNumber\\\":-1,\\\"className\\\":\\\"sun.reflect.GeneratedConstructorAccessor42\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"newInstance\\\",\\\"fileName\\\":\\\"DelegatingConstructorAccessorImpl.java\\\",\\\"lineNumber\\\":45,\\\"className\\\":\\\"sun.reflect.DelegatingConstructorAccessorImpl\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"newInstance\\\",\\\"fileName\\\":\\\"Constructor.java\\\",\\\"lineNumber\\\":423,\\\"className\\\":\\\"java.lang.reflect.Constructor\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"call\\\",\\\"fileName\\\":\\\"AnnotatedConstructor.java\\\",\\\"lineNumber\\\":124,\\\"className\\\":\\\"com.fasterxml.jackson.databind.introspect.Ann<...truncated...>\",\n                \"DocumentId\": \"<urn:uuid:270f4f71-480e-476f-a875-06dc6187a4a9>https://www.cooltura.mk/kulturni_nastani/literatura/kavadarecki-recnik/\",\n                \"DocumentMetadata\": {},\n                \"EndOffsetMap\": {\n                    \"WAT\": 892711694\n                },\n                \"RecordType\": \"metadata,WAT_METADATA_WARC_RESPONSE_PAYLOAD\",\n                \"StartOffsetMap\": {\n                    \"WAT\": 892709352\n                }\n            },\n            {\n                \"Contents\": \"{\\\"commonCrawlFileType\\\":\\\"WARC\\\",\\\"protocol\\\":\\\"WARC\\\",\\\"version\\\":1.0,\\\"recordType\\\":\\\"response,WARC_HTTP_RESPONSE_PAYLOAD\\\",\\\"date\\\":1656406197000,\\\"recordId\\\":\\\"<urn:uuid:f054a31e-d5aa-42a8-92e3-40acecd9e820>\\\",\\\"targetUri\\\":\\\"https://www.cooltura.mk/kulturni_nastani/literatura/kavadarecki-recnik/\\\",\\\"contentType\\\":\\\"APPLICATION_HTTP\\\",\\\"contentLength\\\":1736,\\\"warcDoc\\\":{\\\"documentRecordTypes\\\":\\\"WARC_HTTP_RESPONSE_PAYLOAD\\\",\\\"docValue\\\":\\\"exception in reading WARC record from JSON: HTTP/1.1 200 OK\\\\r\\\\nDate: Tue, 28 Jun 2022 08:49:57 GMT\\\\r\\\\nContent-Type: text/html\\\\r\\\\nX-Crawler-Transfer-Encoding: chunked\\\\r\\\\nConnection: close\\\\r\\\\nServer: imunify360-webshield/1.18\\\\r\\\\nLast-Modified: Tuesday, 28-Jun-2022 08:49:57 GMT\\\\r\\\\nCache-Control: private, no-store, no-cache, must-revalidate, proxy-revalidate, max-age=0, s-maxage=0\\\\r\\\\ncf-edge-cache: no-cache\\\\r\\\\nContent-Length: 1364\\\\r\\\\n\\\\r\\\\n<!doctype html>\\\\n<html>\\\\n<head>\\\\n<meta charset=\\\\\\\"utf-8\\\\\\\">\\\\n<meta name=\\\\\\\"robots\\\\\\\" content=\\\\\\\"noindex, nofollow\\\\\\\">\\\\n<title>One moment, please...</title>\\\\n<style>\\\\nbody {\\\\n    background: #F6F7F8;\\\\n    color: #303131;\\\\n    font-family: sans-serif;\\\\n    margin-top: 45vh;\\\\n    text-align: center;\\\\n}\\\\n</style>\\\\n</head>\\\\n<body>\\\\n<h1 class=&#x27;preserveHtml&#x27; class=&#x27;preserveHtml&#x27;>Please wait while your request is being verified...</h1>\\\\n<form id=\\\\\\\"wsidchk-form\\\\\\\" style=\\\\\\\"display:none;\\\\\\\" action=\\\\\\\"/z0f76a1d14fd21a8fb5fd0d03e0fdc3d3cedae52f\\\\\\\" method=\\\\\\\"get\\\\\\\">\\\\n<input type=\\\\\\\"hidden\\\\\\\" id=\\\\\\\"wsidchk\\\\\\\" name=\\\\\\\"wsidchk\\\\\\\"/>\\\\n</form>\\\\n<script>\\\\n(function(){\\\\n    var west=+((+!+[])+(+!+[]+!![]+!![]+!![]+!![]+!![]+[])+(+!+[]+!![]+!![]+!![]+!![])+(+![]+[])+(+!+[]+!![]+!![]+!![])+(+!+[]+!![]+!![]+!![]+!![]+!![]+!![]+[])+(+!+[]+!![]+!![]+!![]+!![]+!![]+!![]+!![])+(+!+[]+!![]+!![]+!![]+!![]+!![]+[])),\\\\n        east=+((+!+[])+(+!+[]+!![]+!![]+!![]+!![]+!![]+[])+(+!+[]+!![]+!![])+(+!+[]+!![]+!![]+!![]+!![]+[])+(+!+[])+(+!+[]+!![]+[])+(+!+[]+!![])+(+!+[]+!![]+!![]+[])),\\\\n        x=function(){try{return !!window.addEventListener;}catch(e){return !!0;} },\\\\n        y=function(y,z){x() ? document.addEventListener(\\\\\\\"DOMContentLoaded\\\\\\\",y,z) : document.attachEvent(\\\\\\\"onreadystatechange\\\\\\\",y);};\\\\n    y(function(){\\\\n        document.getElementById(&#x27;wsidchk&#x27;).value = west + east;\\\\n        document.getElementById(&#x27;wsidchk-form&#x27;).submit();\\\\n    }, false);\\\\n})();\\\\n</script>\\\\n</body>\\\\n</html>\\\",\\\"exception\\\":{\\\"cause\\\":{\\\"cause\\\":{\\\"cause\\\":{\\\"cause\\\":null,\\\"stackTrace\\\":[{\\\"methodName\\\":\\\"parse\\\",\\\"fileName\\\":\\\"DateFormat.java\\\",\\\"lineNumber\\\":366,\\\"className\\\":\\\"java.text.DateFormat\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"getDateFromDateString\\\",\\\"fileName\\\":\\\"DateUtils.java\\\",\\\"lineNumber\\\":38,\\\"className\\\":\\\"com.resonance.commoncrawl.util.DateUtils\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"setHttpHeadersFromMap\\\",\\\"fileName\\\":\\\"WarcHttpResponseDoc.java\\\",\\\"lineNumber\\\":508,\\\"className\\\":\\\"com.resonance.commoncrawl.model.filerecords.docs.WarcHttpResponseDoc\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"getWarcHttpResponseDocFromString\\\",\\\"fileName\\\":\\\"WarcHttpResponseDoc.java\\\",\\\"lineNumber\\\":464,\\\"className\\\":\\\"com.resonance.commoncrawl.model.filerecords.docs.WarcHttpResponseDoc\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"parseDocument\\\",\\\"fileName\\\":\\\"WARCFileParser.java\\\",\\\"lineNumber\\\":191,\\\"className\\\":\\\"com.resonance.saas.data.commoncrawl.parser.WARCFileParser\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"nextRecord\\\",\\\"fileName\\\":\\\"S3SingleFileMultipleDocsReader.java\\\",\\\"lineNumber\\\":206,\\\"className\\\":\\\"com.resonance.saas.data.connectors.read.s3.S3SingleFileMultipleDocsReader\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"getNextRecordFromFileReader\\\",\\\"fileName\\\":\\\"CommonCrawlReader.java\\\",\\\"lineNumber\\\":158,\\\"className\\\":\\\"com.resonance.saas.data.commoncrawl.reader.CommonCrawlReader\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"parseDocument\\\",\\\"fileName\\\":\\\"CommonCrawlReader.java\\\",\\\"lineNumber\\\":347,\\\"className\\\":\\\"com.resonance.saas.data.commoncrawl.reader.CommonCrawlReader\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"nextRecord\\\",\\\"fileName\\\":\\\"S3CompositeFileDocsReader.java\\\",\\\"lineNumber\\\":101,\\\"className\\\":\\\"com.resonance.saas.data.connectors.read.s3.S3CompositeFileDocsReader\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"call\\\",\\\"fileName\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lineNumber\\\":281,\\\"className\\\":\\\"com.resonance.saas.data.processors<...truncated...>\",\n                \"DocumentId\": \"<urn:uuid:f054a31e-d5aa-42a8-92e3-40acecd9e820>https://www.cooltura.mk/kulturni_nastani/literatura/kavadarecki-recnik/\",\n                \"DocumentMetadata\": {},\n                \"EndOffsetMap\": {\n                    \"WARC\": 3467019970\n                },\n                \"RecordType\": \"response,WARC_HTTP_RESPONSE_PAYLOAD\",\n                \"StartOffsetMap\": {\n                    \"WARC\": 3467017610\n                }\n            },\n            {\n                \"Contents\": \"{\\\"commonCrawlFileType\\\":\\\"WAT\\\",\\\"protocol\\\":\\\"WARC\\\",\\\"version\\\":1.0,\\\"recordType\\\":\\\"metadata,WAT_METADATA_WARC_RESPONSE_PAYLOAD\\\",\\\"date\\\":1657368292000,\\\"recordId\\\":\\\"<urn:uuid:611f7676-6fcf-4d9a-afef-b53539fb60ab>\\\",\\\"targetUri\\\":\\\"https://www.cooltura.mk/ostanato/d0-b1-d0-b0-d0-bb-d0-b5-d1-82-d0-be-d1-82-e2-80-9e-d0-b4-d0-be-d0-bd-d0-ba-d0-b8-d1-85-d0-be-d1-82-e2-80-9c-d0-b4-d0-b5-d0-bb-d0-be-d0-b4-d0-bc-d0-b0-d1-98-d1-81-d0-ba-d0-b8-d1-82-d0-b5-d0-be/\\\",\\\"contentType\\\":\\\"APPLICATION_JSON\\\",\\\"contentLength\\\":2154,\\\"warcDoc\\\":{\\\"documentRecordTypes\\\":\\\"WAT_METADATA_WARC_RESPONSE_PAYLOAD\\\",\\\"docValue\\\":\\\"exception in reading WAT record from JSON: {\\\\\\\"Container\\\\\\\":{\\\\\\\"Filename\\\\\\\":\\\\\\\"CC-MAIN-20220628081102-20220628111102-00329.warc.gz\\\\\\\",\\\\\\\"Compressed\\\\\\\":true,\\\\\\\"Offset\\\\\\\":\\\\\\\"790226781\\\\\\\",\\\\\\\"Gzip-Metadata\\\\\\\":{\\\\\\\"Deflate-Length\\\\\\\":\\\\\\\"1288\\\\\\\",\\\\\\\"Header-Length\\\\\\\":\\\\\\\"10\\\\\\\",\\\\\\\"Footer-Length\\\\\\\":\\\\\\\"8\\\\\\\",\\\\\\\"Inflated-CRC\\\\\\\":\\\\\\\"-1688736832\\\\\\\",\\\\\\\"Inflated-Length\\\\\\\":\\\\\\\"2547\\\\\\\"}},\\\\\\\"Envelope\\\\\\\":{\\\\\\\"Payload-Metadata\\\\\\\":{\\\\\\\"Actual-Content-Type\\\\\\\":\\\\\\\"application/http; msgtype=response\\\\\\\",\\\\\\\"HTTP-Response-Metadata\\\\\\\":{\\\\\\\"Response-Message\\\\\\\":{\\\\\\\"Status\\\\\\\":\\\\\\\"200\\\\\\\",\\\\\\\"Version\\\\\\\":\\\\\\\"HTTP/1.1\\\\\\\",\\\\\\\"Reason\\\\\\\":\\\\\\\"OK\\\\\\\"},\\\\\\\"Headers-Length\\\\\\\":\\\\\\\"372\\\\\\\",\\\\\\\"Headers\\\\\\\":{\\\\\\\"Date\\\\\\\":\\\\\\\"Tue, 28 Jun 2022 08:32:59 GMT\\\\\\\",\\\\\\\"Content-Type\\\\\\\":\\\\\\\"text/html\\\\\\\",\\\\\\\"X-Crawler-Transfer-Encoding\\\\\\\":\\\\\\\"chunked\\\\\\\",\\\\\\\"Connection\\\\\\\":\\\\\\\"close\\\\\\\",\\\\\\\"Server\\\\\\\":\\\\\\\"imunify360-webshield/1.18\\\\\\\",\\\\\\\"Last-Modified\\\\\\\":\\\\\\\"Tuesday, 28-Jun-2022 08:32:59 GMT\\\\\\\",\\\\\\\"Cache-Control\\\\\\\":\\\\\\\"private, no-store, no-cache, must-revalidate, proxy-revalidate, max-age=0, s-maxage=0\\\\\\\",\\\\\\\"cf-edge-cache\\\\\\\":\\\\\\\"no-cache\\\\\\\",\\\\\\\"Content-Length\\\\\\\":\\\\\\\"1397\\\\\\\"},\\\\\\\"HTML-Metadata\\\\\\\":{\\\\\\\"Head\\\\\\\":{\\\\\\\"Metas\\\\\\\":[{\\\\\\\"name\\\\\\\":\\\\\\\"robots\\\\\\\",\\\\\\\"content\\\\\\\":\\\\\\\"noindex, nofollow\\\\\\\"}],\\\\\\\"Title\\\\\\\":\\\\\\\"One moment, please...\\\\\\\"},\\\\\\\"Links\\\\\\\":[{\\\\\\\"path\\\\\\\":\\\\\\\"FORM@/action\\\\\\\",\\\\\\\"url\\\\\\\":\\\\\\\"/z0f76a1d14fd21a8fb5fd0d03e0fdc3d3cedae52f\\\\\\\",\\\\\\\"method\\\\\\\":\\\\\\\"get\\\\\\\"}]},\\\\\\\"Entity-Length\\\\\\\":\\\\\\\"1397\\\\\\\",\\\\\\\"Entity-Digest\\\\\\\":\\\\\\\"sha1:4BZEZIIBDRUSKYBETPIBAOCAXSHPJCYE\\\\\\\",\\\\\\\"Entity-Trailing-Slop-Length\\\\\\\":\\\\\\\"0\\\\\\\"},\\\\\\\"Actual-Content-Length\\\\\\\":\\\\\\\"1769\\\\\\\",\\\\\\\"Trailing-Slop-Length\\\\\\\":\\\\\\\"4\\\\\\\",\\\\\\\"Block-Digest\\\\\\\":\\\\\\\"sha1:GVZNUIT6OIO5QQYWJJD3HOQ3VFGGSBZW\\\\\\\"},\\\\\\\"Format\\\\\\\":\\\\\\\"WARC/1.0\\\\\\\",\\\\\\\"WARC-Header-Length\\\\\\\":\\\\\\\"774\\\\\\\",\\\\\\\"WARC-Header-Metadata\\\\\\\":{\\\\\\\"WARC-Type\\\\\\\":\\\\\\\"response\\\\\\\",\\\\\\\"WARC-Date\\\\\\\":\\\\\\\"2022-06-28T08:32:59Z\\\\\\\",\\\\\\\"WARC-Record-ID\\\\\\\":\\\\\\\"<urn:uuid:26cedb63-7607-417d-9bda-47d8795e7288>\\\\\\\",\\\\\\\"Content-Length\\\\\\\":\\\\\\\"1769\\\\\\\",\\\\\\\"Content-Type\\\\\\\":\\\\\\\"application/http; msgtype=response\\\\\\\",\\\\\\\"WARC-Warcinfo-ID\\\\\\\":\\\\\\\"<urn:uuid:6b3e3709-13cb-43f7-836e-323ea880ea6a>\\\\\\\",\\\\\\\"WARC-Concurrent-To\\\\\\\":\\\\\\\"<urn:uuid:eef0ea71-9126-4dd2-870e-72986727dc1b>\\\\\\\",\\\\\\\"WARC-IP-Address\\\\\\\":\\\\\\\"91.121.63.143\\\\\\\",\\\\\\\"WARC-Target-URI\\\\\\\":\\\\\\\"https://www.cooltura.mk/ostanato/d0-b1-d0-b0-d0-bb-d0-b5-d1-82-d0-be-d1-82-e2-80-9e-d0-b4-d0-be-d0-bd-d0-ba-d0-b8-d1-85-d0-be-d1-82-e2-80-9c-d0-b4-d0-b5-d0-bb-d0-be-d0-b4-d0-bc-d0-b0-d1-98-d1-81-d0-ba-d0-b8-d1-82-d0-b5-d0-be/\\\\\\\",\\\\\\\"WARC-Payload-Digest\\\\\\\":\\\\\\\"sha1:4BZEZIIBDRUSKYBETPIBAOCAXSHPJCYE\\\\\\\",\\\\\\\"WARC-Block-Digest\\\\\\\":\\\\\\\"sha1:GVZNUIT6OIO5QQYWJJD3HOQ3VFGGSBZW\\\\\\\",\\\\\\\"WARC-Identified-Payload-Type\\\\\\\":\\\\\\\"text/html\\\\\\\"}}}\\\",\\\"exception\\\":{\\\"cause\\\":{\\\"cause\\\":{\\\"cause\\\":{\\\"cause\\\":{\\\"cause\\\":null,\\\"stackTrace\\\":[{\\\"methodName\\\":\\\"parse\\\",\\\"fileName\\\":\\\"DateFormat.java\\\",\\\"lineNumber\\\":366,\\\"className\\\":\\\"java.text.DateFormat\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"getDateFromDateString\\\",\\\"fileName\\\":\\\"DateUtils.java\\\",\\\"lineNumber\\\":38,\\\"className\\\":\\\"com.resonance.commoncrawl.util.DateUtils\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"setHttpHeadersFromMap\\\",\\\"fileName\\\":\\\"WarcHttpResponseDoc.java\\\",\\\"lineNumber\\\":508,\\\"className\\\":\\\"com.resonance.commoncrawl.model.filerecords.docs.WarcHttpResponseDoc\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"<init>\\\",\\\"fileName\\\":\\\"WarcResponsePayloadMetadata.java\\\",\\\"lineNumber\\\":406,\\\"className\\\":\\\"com.resonance.commoncrawl.model.filerecords.docs.watmetadata.envelope.payloadmetadata.WarcResponsePayloadMetadata$ResponsePayloadHttpMetadata\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"newInstance\\\",\\\"fileName\\\":null,\\\"lineNumber\\\":-1,\\\"className\\\":\\\"sun.reflect.GeneratedConstructorAccessor42\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"newInstance\\\",\\\"fileName\\\":\\\"DelegatingConstructorAccessorImpl.java\\\",\\\"lineNumber\\\":45,\\\"className\\\":\\\"sun.reflect.DelegatingConstructorAc<...truncated...>\",\n                \"DocumentId\": \"<urn:uuid:611f7676-6fcf-4d9a-afef-b53539fb60ab>https://www.cooltura.mk/ostanato/d0-b1-d0-b0-d0-bb-d0-b5-d1-82-d0-be-d1-82-e2-80-9e-d0-b4-d0-be-d0-bd-d0-ba-d0-b8-d1-85-d0-be-d1-82-e2-80-9c-d0-b4-d0-b5-d0-bb-d0-be-d0-b4-d0-bc-d0-b0-d1-98-d1-81-d0-ba-d0-b8-d1-82-d0-b5-d0-be/\",\n                \"DocumentMetadata\": {},\n                \"EndOffsetMap\": {\n                    \"WAT\": 892718269\n                },\n                \"RecordType\": \"metadata,WAT_METADATA_WARC_RESPONSE_PAYLOAD\",\n                \"StartOffsetMap\": {\n                    \"WAT\": 892715617\n                }\n            },\n            {\n                \"Contents\": \"{\\\"commonCrawlFileType\\\":\\\"WARC\\\",\\\"protocol\\\":\\\"WARC\\\",\\\"version\\\":1.0,\\\"recordType\\\":\\\"response,WARC_HTTP_RESPONSE_PAYLOAD\\\",\\\"date\\\":1656405179000,\\\"recordId\\\":\\\"<urn:uuid:26cedb63-7607-417d-9bda-47d8795e7288>\\\",\\\"targetUri\\\":\\\"https://www.cooltura.mk/ostanato/d0-b1-d0-b0-d0-bb-d0-b5-d1-82-d0-be-d1-82-e2-80-9e-d0-b4-d0-be-d0-bd-d0-ba-d0-b8-d1-85-d0-be-d1-82-e2-80-9c-d0-b4-d0-b5-d0-bb-d0-be-d0-b4-d0-bc-d0-b0-d1-98-d1-81-d0-ba-d0-b8-d1-82-d0-b5-d0-be/\\\",\\\"contentType\\\":\\\"APPLICATION_HTTP\\\",\\\"contentLength\\\":1769,\\\"warcDoc\\\":{\\\"documentRecordTypes\\\":\\\"WARC_HTTP_RESPONSE_PAYLOAD\\\",\\\"docValue\\\":\\\"exception in reading WARC record from JSON: HTTP/1.1 200 OK\\\\r\\\\nDate: Tue, 28 Jun 2022 08:32:59 GMT\\\\r\\\\nContent-Type: text/html\\\\r\\\\nX-Crawler-Transfer-Encoding: chunked\\\\r\\\\nConnection: close\\\\r\\\\nServer: imunify360-webshield/1.18\\\\r\\\\nLast-Modified: Tuesday, 28-Jun-2022 08:32:59 GMT\\\\r\\\\nCache-Control: private, no-store, no-cache, must-revalidate, proxy-revalidate, max-age=0, s-maxage=0\\\\r\\\\ncf-edge-cache: no-cache\\\\r\\\\nContent-Length: 1397\\\\r\\\\n\\\\r\\\\n<!doctype html>\\\\n<html>\\\\n<head>\\\\n<meta charset=\\\\\\\"utf-8\\\\\\\">\\\\n<meta name=\\\\\\\"robots\\\\\\\" content=\\\\\\\"noindex, nofollow\\\\\\\">\\\\n<title>One moment, please...</title>\\\\n<style>\\\\nbody {\\\\n    background: #F6F7F8;\\\\n    color: #303131;\\\\n    font-family: sans-serif;\\\\n    margin-top: 45vh;\\\\n    text-align: center;\\\\n}\\\\n</style>\\\\n</head>\\\\n<body>\\\\n<h1 class=&#x27;preserveHtml&#x27; class=&#x27;preserveHtml&#x27;>Please wait while your request is being verified...</h1>\\\\n<form id=\\\\\\\"wsidchk-form\\\\\\\" style=\\\\\\\"display:none;\\\\\\\" action=\\\\\\\"/z0f76a1d14fd21a8fb5fd0d03e0fdc3d3cedae52f\\\\\\\" method=\\\\\\\"get\\\\\\\">\\\\n<input type=\\\\\\\"hidden\\\\\\\" id=\\\\\\\"wsidchk\\\\\\\" name=\\\\\\\"wsidchk\\\\\\\"/>\\\\n</form>\\\\n<script>\\\\n(function(){\\\\n    var west=+((+!+[]+!![]+!![]+!![]+!![])+(+!+[]+!![]+!![]+!![]+!![]+!![]+!![]+!![]+!![]+[])+(+!+[]+!![]+!![]+!![]+!![]+!![]+!![]+!![])+(+!+[]+!![]+!![]+!![]+!![]+[])+(+![])+(+!+[]+!![]+[])+(+!+[])),\\\\n        east=+((+!+[])+(+!+[]+!![]+!![]+[])+(+![])+(+!+[]+!![]+!![]+!![]+!![]+!![]+!![]+!![]+!![]+[])+(+!+[]+!![]+!![]+!![]+!![]+!![]+!![])+(+!+[]+!![]+!![]+[])+(+!+[]+!![]+!![]+!![]+!![]+!![])+(+!+[]+!![]+!![]+!![]+!![]+!![]+!![]+!![]+[])),\\\\n        x=function(){try{return !!window.addEventListener;}catch(e){return !!0;} },\\\\n        y=function(y,z){x() ? document.addEventListener(\\\\\\\"DOMContentLoaded\\\\\\\",y,z) : document.attachEvent(\\\\\\\"onreadystatechange\\\\\\\",y);};\\\\n    y(function(){\\\\n        document.getElementById(&#x27;wsidchk&#x27;).value = west + east;\\\\n        document.getElementById(&#x27;wsidchk-form&#x27;).submit();\\\\n    }, false);\\\\n})();\\\\n</script>\\\\n</body>\\\\n</html>\\\",\\\"exception\\\":{\\\"cause\\\":{\\\"cause\\\":{\\\"cause\\\":{\\\"cause\\\":null,\\\"stackTrace\\\":[{\\\"methodName\\\":\\\"parse\\\",\\\"fileName\\\":\\\"DateFormat.java\\\",\\\"lineNumber\\\":366,\\\"className\\\":\\\"java.text.DateFormat\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"getDateFromDateString\\\",\\\"fileName\\\":\\\"DateUtils.java\\\",\\\"lineNumber\\\":38,\\\"className\\\":\\\"com.resonance.commoncrawl.util.DateUtils\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"setHttpHeadersFromMap\\\",\\\"fileName\\\":\\\"WarcHttpResponseDoc.java\\\",\\\"lineNumber\\\":508,\\\"className\\\":\\\"com.resonance.commoncrawl.model.filerecords.docs.WarcHttpResponseDoc\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"getWarcHttpResponseDocFromString\\\",\\\"fileName\\\":\\\"WarcHttpResponseDoc.java\\\",\\\"lineNumber\\\":464,\\\"className\\\":\\\"com.resonance.commoncrawl.model.filerecords.docs.WarcHttpResponseDoc\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"parseDocument\\\",\\\"fileName\\\":\\\"WARCFileParser.java\\\",\\\"lineNumber\\\":191,\\\"className\\\":\\\"com.resonance.saas.data.commoncrawl.parser.WARCFileParser\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"nextRecord\\\",\\\"fileName\\\":\\\"S3SingleFileMultipleDocsReader.java\\\",\\\"lineNumber\\\":206,\\\"className\\\":\\\"com.resonance.saas.data.connectors.read.s3.S3SingleFileMultipleDocsReader\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"getNextRecordFromFileReader\\\",\\\"fileName\\\":\\\"CommonCrawlReader.java\\\",\\\"lineNumber\\\":158,\\\"className\\\":\\\"com.resonance.saas.data.commoncrawl.reader.CommonCrawlReader\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"parseDocument\\\",\\\"fileName\\\":\\\"CommonCrawlReader.java\\\",\\\"lineNumber\\\":347,\\\"className\\\":\\\"com.resonance.saas.data.commoncrawl.reader.CommonCrawlReader\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"nextRecord\\\",\\\"fileName\\\":\\\"S3CompositeFileDocsReader.java\\\",\\\"lineNumber\\\":101,\\\"className\\\":\\\"com.resonance.saas.data.conn<...truncated...>\",\n                \"DocumentId\": \"<urn:uuid:26cedb63-7607-417d-9bda-47d8795e7288>https://www.cooltura.mk/ostanato/d0-b1-d0-b0-d0-bb-d0-b5-d1-82-d0-be-d1-82-e2-80-9e-d0-b4-d0-be-d0-bd-d0-ba-d0-b8-d1-85-d0-be-d1-82-e2-80-9c-d0-b4-d0-b5-d0-bb-d0-be-d0-b4-d0-bc-d0-b0-d1-98-d1-81-d0-ba-d0-b8-d1-82-d0-b5-d0-be/\",\n                \"DocumentMetadata\": {},\n                \"EndOffsetMap\": {\n                    \"WARC\": 3467024186\n                },\n                \"RecordType\": \"response,WARC_HTTP_RESPONSE_PAYLOAD\",\n                \"StartOffsetMap\": {\n                    \"WARC\": 3467021639\n                }\n            },\n            {\n                \"Contents\": \"{\\\"commonCrawlFileType\\\":\\\"WAT\\\",\\\"protocol\\\":\\\"WARC\\\",\\\"version\\\":1.0,\\\"recordType\\\":\\\"metadata,WAT_METADATA_WARC_RESPONSE_PAYLOAD\\\",\\\"date\\\":1657368296000,\\\"recordId\\\":\\\"<urn:uuid:a9e2d005-25f6-4560-ac21-81ba3ab79afa>\\\",\\\"targetUri\\\":\\\"https://www.curiouscatbar.co.uk/wp-content/uploads/2022/05/Curious-Cat-Jubilee-Cocktails-Menu.pdf\\\",\\\"contentType\\\":\\\"APPLICATION_JSON\\\",\\\"contentLength\\\":1814,\\\"warcDoc\\\":{\\\"documentRecordTypes\\\":\\\"WAT_METADATA_WARC_RESPONSE_PAYLOAD\\\",\\\"docValue\\\":\\\"exception in reading WAT record from JSON: {\\\\\\\"Container\\\\\\\":{\\\\\\\"Filename\\\\\\\":\\\\\\\"CC-MAIN-20220628081102-20220628111102-00329.warc.gz\\\\\\\",\\\\\\\"Compressed\\\\\\\":true,\\\\\\\"Offset\\\\\\\":\\\\\\\"799304654\\\\\\\",\\\\\\\"Gzip-Metadata\\\\\\\":{\\\\\\\"Deflate-Length\\\\\\\":\\\\\\\"1257\\\\\\\",\\\\\\\"Header-Length\\\\\\\":\\\\\\\"10\\\\\\\",\\\\\\\"Footer-Length\\\\\\\":\\\\\\\"8\\\\\\\",\\\\\\\"Inflated-CRC\\\\\\\":\\\\\\\"-851891991\\\\\\\",\\\\\\\"Inflated-Length\\\\\\\":\\\\\\\"2354\\\\\\\"}},\\\\\\\"Envelope\\\\\\\":{\\\\\\\"Payload-Metadata\\\\\\\":{\\\\\\\"Actual-Content-Type\\\\\\\":\\\\\\\"application/http; msgtype=response\\\\\\\",\\\\\\\"HTTP-Response-Metadata\\\\\\\":{\\\\\\\"Response-Message\\\\\\\":{\\\\\\\"Status\\\\\\\":\\\\\\\"200\\\\\\\",\\\\\\\"Version\\\\\\\":\\\\\\\"HTTP/1.1\\\\\\\",\\\\\\\"Reason\\\\\\\":\\\\\\\"OK\\\\\\\"},\\\\\\\"Headers-Length\\\\\\\":\\\\\\\"378\\\\\\\",\\\\\\\"Headers\\\\\\\":{\\\\\\\"Date\\\\\\\":\\\\\\\"Tue, 28 Jun 2022 10:09:00 GMT\\\\\\\",\\\\\\\"Content-Type\\\\\\\":\\\\\\\"application/pdf\\\\\\\",\\\\\\\"X-Crawler-Transfer-Encoding\\\\\\\":\\\\\\\"chunked\\\\\\\",\\\\\\\"Connection\\\\\\\":\\\\\\\"close\\\\\\\",\\\\\\\"Server\\\\\\\":\\\\\\\"imunify360-webshield/1.18\\\\\\\",\\\\\\\"Last-Modified\\\\\\\":\\\\\\\"Tuesday, 28-Jun-2022 10:09:00 GMT\\\\\\\",\\\\\\\"Cache-Control\\\\\\\":\\\\\\\"private, no-store, no-cache, must-revalidate, proxy-revalidate, max-age=0, s-maxage=0\\\\\\\",\\\\\\\"cf-edge-cache\\\\\\\":\\\\\\\"no-cache\\\\\\\",\\\\\\\"Content-Length\\\\\\\":\\\\\\\"1326\\\\\\\"},\\\\\\\"Entity-Length\\\\\\\":\\\\\\\"1326\\\\\\\",\\\\\\\"Entity-Digest\\\\\\\":\\\\\\\"sha1:Z66SBJHNMADVX6SUKU5DI7GMWY7I3MIC\\\\\\\",\\\\\\\"Entity-Trailing-Slop-Length\\\\\\\":\\\\\\\"0\\\\\\\"},\\\\\\\"Actual-Content-Length\\\\\\\":\\\\\\\"1704\\\\\\\",\\\\\\\"Trailing-Slop-Length\\\\\\\":\\\\\\\"4\\\\\\\",\\\\\\\"Block-Digest\\\\\\\":\\\\\\\"sha1:KKQTVLZWY52MYOXO55RFGHPZFOE4O47F\\\\\\\"},\\\\\\\"Format\\\\\\\":\\\\\\\"WARC/1.0\\\\\\\",\\\\\\\"WARC-Header-Length\\\\\\\":\\\\\\\"646\\\\\\\",\\\\\\\"WARC-Header-Metadata\\\\\\\":{\\\\\\\"WARC-Type\\\\\\\":\\\\\\\"response\\\\\\\",\\\\\\\"WARC-Date\\\\\\\":\\\\\\\"2022-06-28T10:09:02Z\\\\\\\",\\\\\\\"WARC-Record-ID\\\\\\\":\\\\\\\"<urn:uuid:3f9f39bf-8a64-4b1c-8eb9-d3f54fe82848>\\\\\\\",\\\\\\\"Content-Length\\\\\\\":\\\\\\\"1704\\\\\\\",\\\\\\\"Content-Type\\\\\\\":\\\\\\\"application/http; msgtype=response\\\\\\\",\\\\\\\"WARC-Warcinfo-ID\\\\\\\":\\\\\\\"<urn:uuid:6b3e3709-13cb-43f7-836e-323ea880ea6a>\\\\\\\",\\\\\\\"WARC-Concurrent-To\\\\\\\":\\\\\\\"<urn:uuid:29bdf479-7dc9-4f3c-90b9-a42bced5040c>\\\\\\\",\\\\\\\"WARC-IP-Address\\\\\\\":\\\\\\\"94.229.64.146\\\\\\\",\\\\\\\"WARC-Target-URI\\\\\\\":\\\\\\\"https://www.curiouscatbar.co.uk/wp-content/uploads/2022/05/Curious-Cat-Jubilee-Cocktails-Menu.pdf\\\\\\\",\\\\\\\"WARC-Payload-Digest\\\\\\\":\\\\\\\"sha1:Z66SBJHNMADVX6SUKU5DI7GMWY7I3MIC\\\\\\\",\\\\\\\"WARC-Block-Digest\\\\\\\":\\\\\\\"sha1:KKQTVLZWY52MYOXO55RFGHPZFOE4O47F\\\\\\\",\\\\\\\"WARC-Identified-Payload-Type\\\\\\\":\\\\\\\"text/html\\\\\\\"}}}\\\",\\\"exception\\\":{\\\"cause\\\":{\\\"cause\\\":{\\\"cause\\\":{\\\"cause\\\":{\\\"cause\\\":null,\\\"stackTrace\\\":[{\\\"methodName\\\":\\\"parse\\\",\\\"fileName\\\":\\\"DateFormat.java\\\",\\\"lineNumber\\\":366,\\\"className\\\":\\\"java.text.DateFormat\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"getDateFromDateString\\\",\\\"fileName\\\":\\\"DateUtils.java\\\",\\\"lineNumber\\\":38,\\\"className\\\":\\\"com.resonance.commoncrawl.util.DateUtils\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"setHttpHeadersFromMap\\\",\\\"fileName\\\":\\\"WarcHttpResponseDoc.java\\\",\\\"lineNumber\\\":508,\\\"className\\\":\\\"com.resonance.commoncrawl.model.filerecords.docs.WarcHttpResponseDoc\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"<init>\\\",\\\"fileName\\\":\\\"WarcResponsePayloadMetadata.java\\\",\\\"lineNumber\\\":406,\\\"className\\\":\\\"com.resonance.commoncrawl.model.filerecords.docs.watmetadata.envelope.payloadmetadata.WarcResponsePayloadMetadata$ResponsePayloadHttpMetadata\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"newInstance\\\",\\\"fileName\\\":null,\\\"lineNumber\\\":-1,\\\"className\\\":\\\"sun.reflect.GeneratedConstructorAccessor42\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"newInstance\\\",\\\"fileName\\\":\\\"DelegatingConstructorAccessorImpl.java\\\",\\\"lineNumber\\\":45,\\\"className\\\":\\\"sun.reflect.DelegatingConstructorAccessorImpl\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"newInstance\\\",\\\"fileName\\\":\\\"Constructor.java\\\",\\\"lineNumber\\\":423,\\\"className\\\":\\\"java.lang.reflect.Constructor\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"call\\\",\\\"fileName\\\":\\\"AnnotatedConstructor.java\\\",\\\"lineNumber\\\":124,\\\"className\\\":\\\"com.fasterxml.jackson.databind.introspect.AnnotatedConstructor\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"createFromObjectWith\\\",\\\"fileName\\\":\\\"StdValueInstantiator.java\\\",\\\"lineNumber\\\":283,\\\"className\\\":\\\"com.fasterxml.jackson.databind.deser.std.St<...truncated...>\",\n                \"DocumentId\": \"<urn:uuid:a9e2d005-25f6-4560-ac21-81ba3ab79afa>https://www.curiouscatbar.co.uk/wp-content/uploads/2022/05/Curious-Cat-Jubilee-Cocktails-Menu.pdf\",\n                \"DocumentMetadata\": {},\n                \"EndOffsetMap\": {\n                    \"WAT\": 899526564\n                },\n                \"RecordType\": \"metadata,WAT_METADATA_WARC_RESPONSE_PAYLOAD\",\n                \"StartOffsetMap\": {\n                    \"WAT\": 899524380\n                }\n            },\n            {\n                \"Contents\": \"{\\\"commonCrawlFileType\\\":\\\"WARC\\\",\\\"protocol\\\":\\\"WARC\\\",\\\"version\\\":1.0,\\\"recordType\\\":\\\"response,WARC_HTTP_RESPONSE_PAYLOAD\\\",\\\"date\\\":1656410942000,\\\"recordId\\\":\\\"<urn:uuid:3f9f39bf-8a64-4b1c-8eb9-d3f54fe82848>\\\",\\\"targetUri\\\":\\\"https://www.curiouscatbar.co.uk/wp-content/uploads/2022/05/Curious-Cat-Jubilee-Cocktails-Menu.pdf\\\",\\\"contentType\\\":\\\"APPLICATION_HTTP\\\",\\\"contentLength\\\":1704,\\\"warcDoc\\\":{\\\"documentRecordTypes\\\":\\\"WARC_HTTP_RESPONSE_PAYLOAD\\\",\\\"docValue\\\":\\\"exception in reading WARC record from JSON: HTTP/1.1 200 OK\\\\r\\\\nDate: Tue, 28 Jun 2022 10:09:00 GMT\\\\r\\\\nContent-Type: application/pdf\\\\r\\\\nX-Crawler-Transfer-Encoding: chunked\\\\r\\\\nConnection: close\\\\r\\\\nServer: imunify360-webshield/1.18\\\\r\\\\nLast-Modified: Tuesday, 28-Jun-2022 10:09:00 GMT\\\\r\\\\nCache-Control: private, no-store, no-cache, must-revalidate, proxy-revalidate, max-age=0, s-maxage=0\\\\r\\\\ncf-edge-cache: no-cache\\\\r\\\\nContent-Length: 1326\\\\r\\\\n\\\\r\\\\n<!doctype html>\\\\n<html>\\\\n<head>\\\\n<meta charset=\\\\\\\"utf-8\\\\\\\">\\\\n<meta name=\\\\\\\"robots\\\\\\\" content=\\\\\\\"noindex, nofollow\\\\\\\">\\\\n<title>One moment, please...</title>\\\\n<style>\\\\nbody {\\\\n    background: #F6F7F8;\\\\n    color: #303131;\\\\n    font-family: sans-serif;\\\\n    margin-top: 45vh;\\\\n    text-align: center;\\\\n}\\\\n</style>\\\\n</head>\\\\n<body>\\\\n<h1 class=&#x27;preserveHtml&#x27; class=&#x27;preserveHtml&#x27;>Please wait while your request is being verified...</h1>\\\\n<form id=\\\\\\\"wsidchk-form\\\\\\\" style=\\\\\\\"display:none;\\\\\\\" action=\\\\\\\"/z0f76a1d14fd21a8fb5fd0d03e0fdc3d3cedae52f\\\\\\\" method=\\\\\\\"get\\\\\\\">\\\\n<input type=\\\\\\\"hidden\\\\\\\" id=\\\\\\\"wsidchk\\\\\\\" name=\\\\\\\"wsidchk\\\\\\\"/>\\\\n</form>\\\\n<script>\\\\n(function(){\\\\n    var west=+((+!+[]+!![]+!![]+!![])+(+![]+[])+(+!+[]+!![]+!![]+!![]+!![]+!![])+(+!+[]+!![]+!![]+!![]+!![]+!![]+[])+(+!+[]+!![]+!![]+!![]+!![]+!![])+(+!+[]+!![]+!![]+!![]+!![]+!![]+!![]+[])),\\\\n        east=+((+!+[]+!![]+!![]+!![]+!![]+!![]+!![])+(+!+[]+[])+(+!+[]+!![]+!![]+!![]+!![])+(+!+[]+!![]+!![]+!![]+!![]+!![]+!![]+[])+(+!+[])+(+!+[]+!![]+!![]+!![]+!![]+!![]+[])),\\\\n        x=function(){try{return !!window.addEventListener;}catch(e){return !!0;} },\\\\n        y=function(y,z){x() ? document.addEventListener(\\\\\\\"DOMContentLoaded\\\\\\\",y,z) : document.attachEvent(\\\\\\\"onreadystatechange\\\\\\\",y);};\\\\n    y(function(){\\\\n        document.getElementById(&#x27;wsidchk&#x27;).value = west + east;\\\\n        document.getElementById(&#x27;wsidchk-form&#x27;).submit();\\\\n    }, false);\\\\n})();\\\\n</script>\\\\n</body>\\\\n</html>\\\",\\\"exception\\\":{\\\"cause\\\":{\\\"cause\\\":{\\\"cause\\\":{\\\"cause\\\":null,\\\"stackTrace\\\":[{\\\"methodName\\\":\\\"parse\\\",\\\"fileName\\\":\\\"DateFormat.java\\\",\\\"lineNumber\\\":366,\\\"className\\\":\\\"java.text.DateFormat\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"getDateFromDateString\\\",\\\"fileName\\\":\\\"DateUtils.java\\\",\\\"lineNumber\\\":38,\\\"className\\\":\\\"com.resonance.commoncrawl.util.DateUtils\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"setHttpHeadersFromMap\\\",\\\"fileName\\\":\\\"WarcHttpResponseDoc.java\\\",\\\"lineNumber\\\":508,\\\"className\\\":\\\"com.resonance.commoncrawl.model.filerecords.docs.WarcHttpResponseDoc\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"getWarcHttpResponseDocFromString\\\",\\\"fileName\\\":\\\"WarcHttpResponseDoc.java\\\",\\\"lineNumber\\\":464,\\\"className\\\":\\\"com.resonance.commoncrawl.model.filerecords.docs.WarcHttpResponseDoc\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"parseDocument\\\",\\\"fileName\\\":\\\"WARCFileParser.java\\\",\\\"lineNumber\\\":191,\\\"className\\\":\\\"com.resonance.saas.data.commoncrawl.parser.WARCFileParser\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"nextRecord\\\",\\\"fileName\\\":\\\"S3SingleFileMultipleDocsReader.java\\\",\\\"lineNumber\\\":206,\\\"className\\\":\\\"com.resonance.saas.data.connectors.read.s3.S3SingleFileMultipleDocsReader\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"getNextRecordFromFileReader\\\",\\\"fileName\\\":\\\"CommonCrawlReader.java\\\",\\\"lineNumber\\\":158,\\\"className\\\":\\\"com.resonance.saas.data.commoncrawl.reader.CommonCrawlReader\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"parseDocument\\\",\\\"fileName\\\":\\\"CommonCrawlReader.java\\\",\\\"lineNumber\\\":347,\\\"className\\\":\\\"com.resonance.saas.data.commoncrawl.reader.CommonCrawlReader\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"nextRecord\\\",\\\"fileName\\\":\\\"S3CompositeFileDocsReader.java\\\",\\\"lineNumber\\\":101,\\\"className\\\":\\\"com.resonance.saas.data.connectors.read.s3.S3CompositeFileDocsReader\\\",\\\"nativeMethod\\\":false},{\\\"methodName\\\":\\\"call\\\",\\\"fileName\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lineNumber\\\":281,\\\"className\\\":\\\"com.resonance.saas.data.processors.Reade<...truncated...>\",\n                \"DocumentId\": \"<urn:uuid:3f9f39bf-8a64-4b1c-8eb9-d3f54fe82848>https://www.curiouscatbar.co.uk/wp-content/uploads/2022/05/Curious-Cat-Jubilee-Cocktails-Menu.pdf\",\n                \"DocumentMetadata\": {},\n                \"EndOffsetMap\": {\n                    \"WARC\": 3501890178\n                },\n                \"RecordType\": \"response,WARC_HTTP_RESPONSE_PAYLOAD\",\n                \"StartOffsetMap\": {\n                    \"WARC\": 3501887824\n                }\n            }\n        ],\n        \"id\": \"error/e7148bad-2415-4a61-9189-7ad14ea5a212/aa072857-ef58-4703-97e1-4c1f455e2c0c/CommonCrawlDatasetFull/00009b45de184a92dde4b907b216fcde_892709352_3501890178_1670061736233_6.gz\",\n        \"objectKey\": \"error/e7148bad-2415-4a61-9189-7ad14ea5a212/aa072857-ef58-4703-97e1-4c1f455e2c0c/CommonCrawlDatasetFull/00009b45de184a92dde4b907b216fcde_892709352_3501890178_1670061736233_6.gz\",\n        \"taskId\": \"00009b45de184a92dde4b907b216fcde\"\n    }\n\n

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

Request successfully retrieved the error file. The response body has the error file contents and the error file metadata.

{\n    \"connectorDestination\": \"String\",\n    \"connectorType\": \"String\",\n    \"dataset\": \"String\",\n    \"errorCount\": \"Long\",\n    \"errors\": [\n        {\n            error doc\n        },\n        {\n            error doc\n        },\n        ...\n    ],\n    \"id\": \"String\",\n    \"objectKey\": \"String\",\n    \"taskId\": \"String\"\n}\n\n

404:

The dataset for the tenantId, userId and datasetName was not found in the database. An error code and error message is returned in the response JSON.
\n
```
    {\n      \"statusCode\": \"DATASET_NOT_FOUND\",\n      \"message\": \"Dataset not found in the database.\"\n    }\n\n
```
\n

The dataset has been deleted. Any error files should have been deleted as well.

    {\n      \"statusCode\": \"DELETED\",\n      \"message\": \"datasetStatus is DELETED.\"\n    }\n\n

The error file with filename could not be found.

    {\n      \"statusCode\": \"ERROR_FILE_NOT_FOUND\",\n      \"message\": \"error file not found.\"\n    }\n\n

500:

An unexpected error has occurred.

            {\n            \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n            \"message\": \"Internal Server Error, please try again later.\"\n            }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
\n

Examples:

Example 1: View an error file for the dataset's (IndexWebCrawlDataDec2022) task with taskId 00009b45de184a92dde4b907b216fcde. The error filename is 00009b45de184a92dde4b907b216fcde_892709352_3501890178_1670061736233_6.gz -

GET www.letsdata.io/api/errors?tenantId=tenantId \\\n      &userId=userId \\\n      &datasetName=IndexWebCrawlDataDec2022 \\\n      &filename=00009b45de184a92dde4b907b216fcde_892709352_3501890178_1670061736233_6.gz\n\n

  $ > letsdata errors view --datasetName IndexWebCrawlDataDec2022 --taskId 00009b45de184a92dde4b907b216fcde --filename 00009b45de184a92dde4b907b216fcde_892709352_3501890178_1670061736233_6.gz\n\n

Docs:

You can also learn all about Error Handling at: https://www.letsdata.io/docs#errorhandling
\n
The DocumentInterface is documented at: https://www.letsdata.io/docs/sdk-interface/#documentInterfaceDocsContainer
\n
The ErrorDocInterface is documented at: https://www.letsdata.io/docs/sdk-interface/#errorDocInterfaceDocsContainer
\n
The Default ErrorDoc implementation code is at: https://github.com/lets-data/letsdata-data-interface/blob/main/src/main/java/com/resonance/letsdata/data/documents/implementation/ErrorDoc.java
\n

\n","urlObject":{"path":["api","errors"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

\n","type":"text/plain"},"key":"userId","value":"userId"},{"description":{"content":"

The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022

\n","type":"text/plain"},"key":"datasetName","value":"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20"},{"description":{"content":"

The error filename. For example, 00009b45de184a92dde4b907b216fcde_892709352_3501890178_1670061736233_6.gz. (The errors/list GET api can be used to list the error files for a task)

\n","type":"text/plain"},"key":"filename","value":"shardId-000000000000_49647303705582102337259106459538383112783566454206234626_49647303705582102337259106459539592038603181083380940802_1702428589100_1.gz"}],"variable":[]}},"response":[{"id":"b04705e8-50fa-487e-a2fa-c208b4e5af88","name":"Example - View Error","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/errors?tenantId=tenantId&userId=userId&datasetName=CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20&filename=shardId-000000000000_49647303705582102337259106459538383112783566454206234626_49647303705582102337259106459539592038603181083380940802_1702428589100_1.gz","host":["https://www.letsdata.io"],"path":["api","errors"],"query":[{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner."},{"key":"datasetName","value":"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20","description":"The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022"},{"key":"filename","value":"shardId-000000000000_49647303705582102337259106459538383112783566454206234626_49647303705582102337259106459539592038603181083380940802_1702428589100_1.gz","description":"The error filename. For example, `00009b45de184a92dde4b907b216fcde_892709352_3501890178_1670061736233_6.gz`. (The errors/list GET api can be used to list the error files for a task)"}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:16:23 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"10504"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"581feae4-dc14-46d4-bdd8-eb11adf13e38"},{"key":"x-amz-apigw-id","value":"Ubg6qEj-IAMEEWA="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee1510-2715c3744b7bd078516b6403"}],"cookie":[],"responseTime":null,"body":"{\n \"connectorType\": \"WRITE\",\n \"connectorDestination\": \"S3\",\n \"objectKey\": \"error/d5feaf90-71a9-41ee-b1b9-35e4242c3155/accb3567-2b6e-41ae-b00d-6ce1f9a58d94/CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20/shardId-000000000000_49647303705582102337259106459538383112783566454206234626_49647303705582102337259106459539592038603181083380940802_1702428589100_1.gz\",\n \"id\": \"error/d5feaf90-71a9-41ee-b1b9-35e4242c3155/accb3567-2b6e-41ae-b00d-6ce1f9a58d94/CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20/shardId-000000000000_49647303705582102337259106459538383112783566454206234626_49647303705582102337259106459539592038603181083380940802_1702428589100_1.gz\",\n \"dataset\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"taskId\": \"shardId-000000000000\",\n \"errors\": [\n {\n \"EndOffsetMap\": {\n \"sequenceNumber\": \"49647303705582102337259106459539592038603181083380940802\"\n },\n \"errorType\": \"WriteError\",\n \"StartOffsetMap\": {\n \"sequenceNumber\": \"49647303705582102337259106459538383112783566454206234626\"\n },\n \"errorDocs\": [\n {\n \"Contents\": \"{\\\"documentMetadata\\\":{},\\\"partitionKey\\\":\\\"http://alicegame.xsrv.jp/hina/old_log.php?room_no=1994&reverse_log=on&heaven_talk=on&db_no=2\\\",\\\"blockDigest\\\":\\\"sha1:5VQK2M3G3NEKXJKTOLMWMHU5DB445YTY\\\",\\\"docText\\\":\\\"[1994番地] 【雛1644】やる夫たちの超闇鍋 - 汝は人狼なりや？[過去ログ]\\\\n←戻る\\\\n【雛1644】やる夫たちの超闇鍋村 [1994番地]\\\\n～ん？おやつはクッキー☆かな？～\\\\n[5：3]\\\\n前 1 2 3 4 5 6 7 後　[逆] [霊] [逝] [役] [時] [顔] [観] [狼] [結]\\\\n◆真田明彦GM\\\\n(dummy_boy)\\\\n[占い師]\\\\n(死亡) ◆八九寺真宵\\\\n(道路元標◆\\\\nqFi/JlgvP6)\\\\n[未亡人]\\\\n[共感者]\\\\n(生存中) ◆ヌケニン\\\\n(烏の人◆\\\\n6b6PfT3lfY)\\\\n[出題者]\\\\n(生存中) ◆洩矢諏訪子\\\\n(ルカエバ◆\\\\neyndF0VEv.)\\\\n[萌占い師]\\\\n(死亡) ◆マルフォイ\\\\n(ほーらい◆\\\\nd/IOwLFv9Y)\\\\n[尸解仙]\\\\n(生存中)\\\\n◆モヒカンサム\\\\n(DS◆\\\\nIaSoTYoBkw)\\\\n[ブン屋]\\\\n(死亡) ◆霊夢\\\\n(DarkKnight)\\\\n[翠狼]\\\\n(生存中) ◆リリーホワイト\\\\n(ラグリス◆\\\\n4D5j68U/K6)\\\\n[賢狼]\\\\n(生存中) ◆白澤\\\\n(絶望◆\\\\nJqzIh/uU2g)\\\\n[狡狼]\\\\n(生存中) ◆ハリー・ポッター\\\\n(ディー◆\\\\nYr5YVhO3Zk)\\\\n[夢見人]\\\\n(死亡)\\\\n◆ビスマルク\\\\n(IFV◆\\\\ndP9jsyueYI)\\\\n[人狼]\\\\n(生存中) ◆ハーマイオニー\\\\n(コルクマリー◆\\\\ngBUKEBS0Ok)\\\\n[幻狼]\\\\n(生存中) ◆チルノ\\\\n(町人B◆\\\\nlllllllllA)\\\\n[夢共有者]\\\\n(死亡) ◆龍（ロン）\\\\n(エノク語◆\\\\nCkK42HJiBJ9Z)\\\\n[閻魔]\\\\n(死亡) ◆ダンブルドア\\\\n(磯野)\\\\n[忍者]\\\\n(生存中)\\\\n◆パチュリー\\\\n(氷月ver1)\\\\n[夢求愛者]\\\\n(死亡) ◆ルナチャイルド\\\\n(pulazuma◆\\\\nu.uEbg6cNY)\\\\n[逃亡者]\\\\n(死亡) ◆七夜志貴\\\\n(でっちゃん◆\\\\noPFPs4BDEQ)\\\\n[幻視者]\\\\n(死亡) ◆輿水幸子\\\\n(UG◆\\\\nUG/LW.2UG6vR)\\\\n[宙狐]\\\\n(生存中) ◆魔理沙\\\\n(れな◆\\\\ndgA3NnbC/U)\\\\n[囁き狂人]\\\\n(死亡)\\\\n◆こあくま\\\\n(ふらい)\\\\n[村人]\\\\n(生存中) ◆薔薇水晶\\\\n(幻◆\\\\nC0oOi9CF9A)\\\\n[仙狐]\\\\n[能力喪失]\\\\n(死亡)\\\\n村作成：2014/03/15 (Sat) 14:20:43\\\\n◆GM 「【ローカルルール】\\\\n・AAはCO時以外自由\\\\n・初日に対する能力発動は自由\\\\n・村人騙りは許可\\\\n・おはステ、および完ステは禁止。発覚した場合は吊ること\\\\n・早噛みはPP宣言時と下界で許可された時OK\\\\n・昼投票は200以内を強く推奨。230を超えるようなら名指しで注意することがあります。\\\\n・夜投票は噛みは200以内、それ以外は超過前を推奨。\\\\n・秘密会話が入れてあります\\\\n【禁止事項】\\\\n・昼・開始前の初心者CO\\\\n・開始前と昼と遺言のプレイヤーに関する発言（GMについてなら名乗ってる場合はセーフ）\\\\n・突然死\\\\n・暴言\\\\n・利敵行為（割と人それぞれ線引が違いますので、厳粛に、かつ穏やかにお願いします）\\\\n・ゲーム放棄\\\\n・掛け持ちプレイ\\\\n・占い理由と占い結果の同時貼り\\\\n・ゲーム途中におけるゲーム放棄発言など著しくゲームの雰囲気を乱す行為\\\\n【以下通常の闇鍋テンプレを多少改変したもの】\\\\n・発生保証は人狼1占い1のみ。他に何が出るかはランダム。占いCOする際はお気をつけて。\\\\n・結果が反転する夢占い・夢霊能がいるので○●をそのまま受け取ってはいけません。\\\\n（特殊結果は真夢どちらにせよ同じものが出ます。）\\\\n・占い師が不審者（本人視点ではただの村人、自覚なし）を占うと●が出ます。村人CO\\ufffd\\ufffdは要注意。\\\\n・初日夜に表示される陣営内訳は必ずメモ！　推理の重要な手がかりになります。\\\\n・”CO無し”なんて無い！村人表示も含め、全て役職です。\\\\n無し＝騙りの用意をしてない人外と見られがちなので、何らかの役職COの準備は必ずしておきましょう。\\\\n・出現した役職によっては、死体がいくつも出る可能性があります。閻魔はこれらを判別できます。\\\\n・役職表のページは開いておこう。知らない役職はここでチェック！\\\\nhttp://alicegame.dip.jp/hina/info/new_role/\\\\n・恋人が発生する関係上、狼同士でどっちが先に噛むかの早噛み競争が起こりえます。\\\\nその場合も、夜時間の超過前に噛むのは禁止とします。\\\\n・下界のプレイヤーの役職が見えない時は、蘇生役職がいる可能性アリ。\\\\n席を離れるなら[投票/占う/護衛]から蘇生辞退を申請しておきましょう。\\\\n・夜投票能力のある役職も多い\\ufffd\\ufffdで、夜の時間超過後のリロードは「投票」クリックでやるのがお勧め。\\\\n・鍋のセオリーは十人十色。\\\\n普通村以上に意見のぶつかり合いが起こりやすいですが、熱くなり過ぎないようお願いします。」\\\\n◆GM 「開始、埋まったらor50分」\\\\nkari1 が幻想入りしました\\\\n◆kari1 「どもー」\\\\nヌケニンが幻想入りしました\\\\n◆ヌケニン「よろしく」\\\\n洩矢諏訪子が幻想入りしました\\\\n◆GM 「GM さんが登録情報を変更しました。\\\\n村人の名前：GM → 真田明彦GM\\\\nアイコン：No. 0 (身代わり君用) → No. 3929 (真田明彦)」\\\\n◆洩矢諏訪子「よろしくねー」\\\\nマルフォイが幻想入りしました\\\\n◆真田明彦GM 「よぉ、始まるまで好きにしろ」\\\\n◆マルフォイ「よろしくフォイ」\\\\n◆真田明彦GM 「　i l|　ヽﾍ!　ﾍl\\\\ni l|　ﾘﾒ　ﾊ\\\\ni l|　ｲ l /l　l\\\\ni l|　| / l /!　|\\\\ni l|, --ﾆﾆﾆ´_ l/ ﾘ个　＿ _人_ ＿\\\\ni l|　r'ゞ=ンﾉ !/lﾍ!〉　｀Y´\\\\ni l|　/ 〃　|\\\\ni l|　! 〃\\\\ni l|　/‐'　一緒に牛丼\\\\ni l|　/ ／＼\\\\ni l|　/!　／　l　＼\\\\ni l|フ　.ｲ!/. ┌\\ufffd\\ufffd┐\\\\ni l|　／　{'　├─┤ ＿|_,　＿/＿\\\\ni l| ／/ ／ト､ ├─┘ |／⌒ヽ /　＼　│　|　‐┼‐、＼\\\\ni l|-‐'´　|:: ヽ..　│＼／ ./|　|　/ ＿__|　│　|　/ 〉\\\\ni l|　|:: :: ヽ　／　＼　|　ノ　＼ノ＼.　｜　/.　､/\\\\ni l|　|:: :: :: ヽ\\\\ni l|　|:: :: :: :: :ヽ、_\\\\ni l|ヽ　/!:: :: :: :: :: :＼::ヽ､\\\\ni l|　ヽ　/ !:: :: :: :: :: :: :: ＼::｀ヽ」\\\\nモヒカンサムが幻想入りしました\\\\n◆モヒカンサム「ひゃっはー」\\\\n◆真田明彦GM 「遺言を誤爆するとは・・・失態だな」\\\\n霊夢が幻想入りしました\\\\n◆霊夢「よろ」\\\\n◆kari1 「kari1 さんが登録情報を変更しました。\\\\n村人の名前：kari1 → 八九寺真宵\\\\nアイコン：No. 1 (明灰) → No. 1175 (八九寺真宵2)」\\\\nリリーホワイトが幻想入りしました\\\\n◆リリーホワイト「よろしくですよー」\\\\n◆八九寺真宵「気にしちゃ駄目ですよ＞GM」\\\\n◆真田明彦GM 「まぁ適当にAA録からもってきてるだけだがな」\\\\n白澤が幻想入りしました\\\\n◆白澤「ニイメンハオよろしくねー」\\\\nハリー・ポッターが幻想入りしました\\\\n◆ハリー・ポッター「よろしくお願いします」\\\\n◆リリーホワイト「ハリポタワーですよー」\\\\n◆マルフォイ「暗殺が出るまで白澤に魔法をかけるフォイ」\\\\n◆真田明彦GM 「まぁ適当に寛いでてくれ\\\\n俺は集まるまで、ギルクエシャガルのレベリングを暇つぶしにやってる」\\\\nかりっが幻想入りしました\\\\n◆かりっ「ちっす」\\\\nハーマイオニーが幻想入りしました\\\\n◆リリーホワイト「モンハンはもうさっぱりついていけないですよー」\\\\n◆ハーマイオニー「綾崎ハーマイオニーです（汗）」\\\\n◆ハリー・ポッター「またポリジュース薬でも飲んだのかい？　＞ハーマイオニー」\\\\nチルノが幻想入りしました\\\\n◆チルノ「よろしくねっ！」\\\\n◆ハーマイオニー「\\\\n｡　｡　Ｏ\\\\n｡　ｏ\\\\n｡　／＼「¨¨´｀ヽ_r-､　｡　o\\\\n/　ヽ　, - ､　＼_,　-─┐\\\\nﾑ　／￣｀ ´　＼＿ , '´ /　｡\\\\n,　´￣｀V　_ノ　ヽ　/　｡\\\\nく -─-､「　| /\\\\n＼　. :.:.:.|　l　i　|　/　/ i |　|/\\\\n＼ . : :.|　l　｀ﾅナK./| ,.ｨイﾊ　/　|{　確かに耳が生えてしまっていますけど！＞ポッターさん\\\\n芥.:.|　l. ::l>´ﾊl/　| /ｲり l/　/ﾘl\\\\n/」l」 | ハ:.|ヽ_り /　¨´,,{　/」l」　こ、こんなはずではなかったんですよ！\\\\nV |＼|:.| ''''' r‐--┐　ﾉl /ィ´ ￣｀ヽ\\\\n「＼|ヽ:|＞ ⊥＿ノ. イ／ /.:.:.:.:｀ヽ〉\\\\n|　入二フ´ /´　/.:.:.:.:.:.:.:.:l　/\\\\n|　/ V( )､ ,. ｲ　/.:.:.:.:.:.:.:.:.:.l/\\\\n|｀ヽ､／⌒ ヽ<...truncated...>\",\n \"RecordType\": \"DOCUMENT\",\n \"DocumentMetadata\": {},\n \"DocumentId\": \"http://alicegame.xsrv.jp/hina/old_log.php?room_no=1994&reverse_log=on&heaven_talk=on&db_no=2\",\n \"ErrorMessage\": \"SQSWriteConnector.SQSMessageSendFailureException: - ex: SQSMessageSendFailureException{errorDetails={messageGroupId=null, messageDeduplicationId=null, messageId=46f4d35c9c217ec278225a9142c56ab7, error=sqs message size exceeds the max allowed bytes (229376)}, message =null, cause =null}\"\n }\n ]\n }\n ],\n \"errorCount\": 1\n}"}],"_postman_id":"eb0e9e45-db45-4dd3-8547-db396c9d352d"}],"id":"38f7886d-30f5-46d7-b3cd-9ea5d414abc7","description":"

Errors during the task execution in parsing records or creating composite records from the parsed records are archived as error documents and classified as Record Errors. The errors resources supports the following API methods:

errors GET - View the error record file.
errors/list GET - List the erros for a task

(Do note that the dataset / task infrastructure errors and unhandled exceptions are classified as Task Errors and are handled differently. Look at the docs for a detailed discussion on Error Handling (https://www.letsdata.io/docs#errorhandling)

\n","_postman_id":"38f7886d-30f5-46d7-b3cd-9ea5d414abc7"},{"name":"logs","item":[{"name":"View Log","id":"321939d0-de41-41a9-a131-84053a73f542","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/logs?tenantId=tenantId&userId=userId&datasetName=CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20&logToken=JAqLdlc7X%2FB75IQAHk5MPefdPeiXzuPMnmJJIMPeKx7l8vCP61hImwaNo8xeMPI8%2FKLxvCweNVsuev1bqMxAViWAZUF4Pwj5%2FRtY8Y4D8Xfbxi%2FlabzBtHVl4hDnnumsfa1f49wNWkQ1sw27ySx1jF2BtgOy8Ou%2FVIBgWeqhyZXrmR7Qx8K4%2BIg3lClxI%2BtTgtNrrJ11xbMER%2B1gVR3TdClRbq0q7YHq0GvF2rTFiLXxvrEa%2BYM4WPK5k69R9F43W6U2dzZZoGuil3Jyy4hOMwtCl%2FmSAkuHeqD%2BhJ%2Fkk7DXhbj0ifi1Wb%2BZMRaCfpOOSZpsqoJHp3n17zEHL3AuoDnaqMj8Cuf78csPF893Qy%2FDFUI%2FHQ%2FRyE2tbZdwtYHMx%2FsaOpMOTdvy%2F4rSJX8s4eOSLxt4D99%2BPye6m7mOVXIjOmDeNAh386PwgbSHEWYsz4jRbEB1Z3nNOacUlnGWD6jRnRvKLh%2F9biLZuTy8OEOpBH7fXSfzj8CNtJYSngBWnPwT%2FH4D0J8RgUIoIeXyYw%3D%3D&forward=true","description":"

logs GET

The contents of a task's logs can be viewed by issuing a GET on the logs resource. Logs can be viewed by either specifying a logToken returned by the list API, or by specifying a taskId and the iteration for which the logs need to be viewed.

Input Parameters:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For Example, --userId 078260ed-3124-4de0-8eee-cc5b5025e7ad (TODO - this can be optional, API gets it from token)
datasetName: The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022
taskId: the taskId of the task whose data we want returned. If iteration and logTokens are not specified, the logs for iteration 0 are returned by default. For example, &taskId=01c06add9fb696bf5f69976661cedd57

Retrieve by logTokens:

logToken: the logToken of the log we want to retrieve. These logTokens are the tokens returned by the tasks/list GET api and the next tokens in logs GET api. For example, `&logToken=AukW/Ogg4J5lX...'
forward: [Optional] When the next token is specified for pagination, the same token can be used to retrieve the next page or the previous page by specifying this boolean parameter. &forward=true fetches the next page, &forward=false fetches the previous page.

Retrieve by iteration:

iteration: [Optional] The dataset tasks are run initially when the dataset is created and initialized. This creates dataset execution metrics and logs - we call this iteration 0. In case there are task errors, the dataset tasks are redriven - this causes another iteration of the dataset execution that emits metrics and logs - we call this iteration 1. By default, the logs GET api lists logs for first iteration (iteration 0). In case the user is interested only in a specific dataset execution iteration, they can specify this via iteration '&iteration=' parameter.

Tailing Logs:

tailLogs: [Optional] Retrieve a task's latest execution logs by using the &tailLogs=true parameter. These will fetch the most recent logs for the task.

Output Parameters:

The output is a JSON map that has the following sections:

    {\n        \"logToken\": \"String\",\n        \"logs\": [\n            \"Serialized JSON for the log line\",\n            \"Serialized JSON for the log line\",\n            \"Serialized JSON for the log line\",\n            ...\n        ]\n    }\n\n

logToken: This is the logs paginationToken. If this is null, then you've reached the end of file (or start of file if forward was set to false). This log token can be used to retrieve the next / previous page in the log. To retrieve the next page, use &forward=true. To retrieve the previous page, use &forward=false
logs: Logs in #Let's Data are emitted as a JSON object that has the following format. Each item in the logs list is a log emitted by the code, transformed to a JSON Map by the logging library and serialized as a string in this list.

Log Format Schema:

    {\n        \"dt\": \"String - human readable datetime\",\n        \"lvl\": \"String - Log level (DEBUG|INFO|WARN|ERROR)\",\n        \"msg\": \"String - the log message\",\n        \"ts\": Long - epoch timestamp in milliseconds,\n        \"cnm\": \"String - the fully qualified class name\",\n        \"fnm\": \"String - the filename\",\n        \"lnm\": Integer - The line number in the file,\n        \"mnm\": \"String - the method name\"\n    }\n\n

Actual Example Output:

Here is an actual example output for the command:

     {\n        \"logToken\": \"8Jvu1v1lOIgAY0KON7u7IOC1v4vkAo4taTB+jpm46D90fKFfrwloJxx5kXyKUfBAHRmhhMPtLRJSTOA8xhxsWGa6WKf3qCU8rOwvvBYZ0C//kfHDGR/uD0ofV/IZ/stw2TpuX+bcShNm14+b6+tEJM4+EmtvFFDiVljdbHEIz4W1bWYWyeMqXyjgdZGz4ScMQYHbsxm2TkJzvhrypR1NMkhm1xq9fal2C9vJaujvni7jFd3nPIzdCG31wa6lfWEyCqi3C+mPWlNQnyKsJ78KABGaqGQyLjqIS9FLD2p6WLOROmiictNmBECTWXBMvPdnWRn7/gg5fBeYSnoHrYMwbifqNzcqv7vYjHkgJz4Zg1GRKi+N/bjPdjeqDo0PuFmLM/nRfxmSanlwQo42k4nIKX1CnLVSRS64djvRKyDXU84Sk6e+3+YvQklWCcne38LM5tkuyIRGTO3+YyG+I2AKDtPCXapuUHg54xmjCjxtnou8yc+PHM/kxlszHo837Wl3SLI/flGfQj4HYw8W7UKk4ZFCuH2kdilA3S6TO+ZVgjnecwRC1lHugGFFWftKlIMlItOJC7sWUvHKOKfFkzjduIRVSLq6OcSNR1Jl4jSIg1FGe08dCbsJDp+3XejWyRcM\",\n        \"logs\": [\n            \"{\\\"dt\\\":\\\"Dec 3, 2022 9:27:21 AM\\\",\\\"lvl\\\":\\\"INFO\\\",\\\"msg\\\":\\\"updated an task to the current worker - existingStatus: CREATED\\\",\\\"ts\\\":1670059641462,\\\"cnm\\\":\\\"com.resonance.letsdata.database.tasks.SimpleTaskDBImpl\\\",\\\"fnm\\\":\\\"SimpleTaskDBImpl.java\\\",\\\"lnm\\\":129,\\\"mnm\\\":\\\"selectTask\\\"}\\n\",\n            \"{\\\"dt\\\":\\\"Dec 3, 2022 9:27:21 AM\\\",\\\"lvl\\\":\\\"INFO\\\",\\\"msg\\\":\\\"selected task for processing by the worker null|57ce7317-5789-4e54-aabd-75154eb1b460 and callable e31f2fdc-40c0-4535-a6f6-76a898b9cd15 - datasetName: CommonCrawlDatasetFull, fileName: 01c06add9fb696bf5f69976661cedd57, taskStatus: PROCESSING\\\",\\\"ts\\\":1670059641462,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":198,\\\"mnm\\\":\\\"call\\\"}\\n\",\n            \"{\\\"dt\\\":\\\"Dec 3, 2022 9:27:24 AM\\\",\\\"lvl\\\":\\\"INFO\\\",\\\"msg\\\":\\\"writeConnector put records retryableRequests are \\\\u003e 0 - attempting another putRecordsWithRetries - filename: 01c06add9fb696bf5f69976661cedd57 - retryableRecords: 475 - retryCount: 0\\\",\\\"ts\\\":1670059644387,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":563,\\\"mnm\\\":\\\"writeRecordsWithRetries\\\"}\\n\"\n            ...\n        ]\n    }\n\n

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

Request successfully retrieved the error file. The response body has the error file contents and the error file metadata.

      {\n          \"logToken\": \"String\",\n          \"logs\": [\n              \"Serialized JSON for the log line\",\n              \"Serialized JSON for the log line\",\n              \"Serialized JSON for the log line\",\n              ...\n          ]\n      }\n\n

400:
\n
- Specify either a logToken or taskId to view the task logs.
  \n
```
        {\n          \"statusCode\": \"MISSING_PARAMETER\",\n          \"message\": \"specify either a logToken or taskId to view the task logs.\"\n        }\n\n
```
  \n
- The tailLogs should be null when using logTokens. tailLogs retrieves the latest logs from latest iteration whereas logTokens specify a particular iteration's logs. Specifying both parameters makes the log retrieval ambiguous. Remove tail logs to retrieve the logs specified by the logToken, or remove the logToken to retrieve latest logs.
  \n
```
        {\n          \"statusCode\": \"UNSUPPORTED_PARAMETER\",\n          \"message\": \"tailLogs should be null when logToken is specified.\"\n        }\n\n
```
  \n
- The logToken seems to be for a different dataset. Either the tenantId, userId or datasetName value is different from the logToken's tenantId / userId / datasetName.
  \n
```
        {\n          \"statusCode\": \"INVALID_PARAMETER\",\n          \"message\": \"datasetName and logToken mismatch. The logToken seems to be for a different dataset.\"\n        }\n\n
```
  \n
- The logToken parameter is specified with taskId. logToken parameter is used when retrieve logs via logTokens (pagination tokens). Either use logTokens or use taskId to retrieves tasks logs (and the use log tokens to paginate)
  \n
```
        {\n          \"statusCode\": \"UNSUPPORTED_PARAMETER\",\n          \"message\": \"logToken should be null when taskId is specified.\"\n        }\n\n
```
  \n
- The forward parameter is specified with taskId. forward parameter is used when retrieve logs via logTokens (page tokens) to retrieve the next / previous paginate. Either use forward with log token or use taskId to retrieves tasks logs (and the use log tokens to paginate)
  \n
```
        {\n          \"statusCode\": \"UNSUPPORTED_PARAMETER\",\n          \"message\": \"forward should be null when taskId is specified.\"\n        }\n\n
```
  \n
- The task iteration number is specified with tailLogs which makes it ambiguous whether to retrieve the latest logs (tail) or the iteration's log. Remove the iteration parameter to retrieve the latest logs.
  \n
```
        {\n          \"statusCode\": \"UNSUPPORTED_PARAMETER\",\n          \"message\": \"iteration should be null when tailLogs is true. With tailLogs specified, the latest iteration's latest log would be retrieved.\"\n        }\n\n
```
  \n
- The task iteration number is invalid (out of bounds).
  \n
```
        {\n          \"statusCode\": \"INVALID_PARAMETER\",\n          \"message\": \"invalid iteration. The task has had %d runs, iteration should be in range [0, %d] (inclusive).\"\n        }\n\n
```
  \n
\n

404:

The dataset for the tenantId, userId and datasetName was not found in the database. An error code and error message is returned in the response JSON.
\n
```
        {\n          \"statusCode\": \"DATASET_NOT_FOUND\",\n          \"message\": \"Dataset not found in the database.\"\n        }\n\n
```
\n

The dataset has been deleted. Any log files should have been deleted as well.

        {\n          \"statusCode\": \"DELETED\",\n          \"message\": \"datasetStatus is DELETED.\"\n        }\n\n

500:
\n
- An unexpected error has occurred.
  \n
```
         {\n             \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n             \"message\": \"Internal Server Error, please try again later.\"\n         }\n\n
```
  \n
- In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
  \n
\n

Examples:

Example 1: retrieve the task logs - retrieves the first page of the logs for iteration 0 (initial run)

      GET www.letsdata.io/api/logs?tenantId=tenantId \\\n          &userId=userId \\\n          &datasetName=IndexWebCrawlDataDec2022 \\\n          &taskId=00009b45de184a92dde4b907b216fcde\n          or\n      GET www.letsdata.io/api/logs?tenantId=tenantId \\\n          &userId=userId \\\n          &datasetName=IndexWebCrawlDataDec2022 \\\n          &taskId=00009b45de184a92dde4b907b216fcde \\\n          &iteration=0\n          or\n      GET www.letsdata.io/api/logs?tenantId=tenantId \\\n          &userId=userId \\\n          &datasetName=IndexWebCrawlDataDec2022 \\\n          &logToken=AukW/Ogg4J5lX...\n

Example 2: tail the task logs - retrieves the most recent logs for the task

GET www.letsdata.io/api/logs?tenantId=tenantId \\\n  &userId=userId \\\n  &datasetName=IndexWebCrawlDataDec2022 \\\n  &taskId=00009b45de184a92dde4b907b216fcde \\\n  &tailLogs=true\n

Example 3: retrieve the task logs - retrieves the first page of the logs for iteration 1 (task redrives)

GET www.letsdata.io/api/logs?tenantId=tenantId \\\n  &userId=userId \\\n  &datasetName=IndexWebCrawlDataDec2022 \\\n  &taskId=00009b45de184a92dde4b907b216fcde \\\n  &iteration=1\n      or\nGET www.letsdata.io/api/logs?tenantId=tenantId \\\n  &userId=userId \\\n  &datasetName=IndexWebCrawlDataDec2022 \\\n  &logToken=AukW/Ogg4J5lX...\n

Example 4: retrieve the task logs - retrieves the next page of the logs

GET www.letsdata.io/api/logs?tenantId=tenantId \\\n    &userId=userId \\\n    &datasetName=IndexWebCrawlDataDec2022 \\\n    &logToken=AukW/Ogg4J5lX...\n        or\nGET www.letsdata.io/api/logs?tenantId=tenantId \\\n    &userId=userId \\\n    &datasetName=IndexWebCrawlDataDec2022 \\\n    &logToken=AukW/Ogg4J5lX... \\\n    &forward=true        \n

Example 5: retrieve the task logs - retrieves the previous page of the logs

GET www.letsdata.io/api/logs?tenantId=tenantId \\\n    &userId=userId \\\n    &datasetName=IndexWebCrawlDataDec2022 \\\n    &logToken=AukW/Ogg4J5lX... \\\n    &forward=false    \n

Docs:

You can also learn all about logs at: https://www.letsdata.io/docs#logs

\n","urlObject":{"path":["api","logs"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

\n","type":"text/plain"},"key":"userId","value":"userId"},{"description":{"content":"

The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022

\n","type":"text/plain"},"key":"datasetName","value":"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20"},{"disabled":true,"description":{"content":"

The taskId of the task whose data we want returned. If iteration and logTokens are not specified, the logs for iteration 0 are returned by default. For example, &taskId=01c06add9fb696bf5f69976661cedd57

\n","type":"text/plain"},"key":"taskId","value":"shardId-000000000000"},{"description":{"content":"

The logToken of the log we want to retrieve. These logTokens are the tokens returned by the tasks/list GET api and the next tokens in logs GET api. For example, `&logToken=AukW%2FOgg4J5lX...'

\n","type":"text/plain"},"key":"logToken","value":"JAqLdlc7X%2FB75IQAHk5MPefdPeiXzuPMnmJJIMPeKx7l8vCP61hImwaNo8xeMPI8%2FKLxvCweNVsuev1bqMxAViWAZUF4Pwj5%2FRtY8Y4D8Xfbxi%2FlabzBtHVl4hDnnumsfa1f49wNWkQ1sw27ySx1jF2BtgOy8Ou%2FVIBgWeqhyZXrmR7Qx8K4%2BIg3lClxI%2BtTgtNrrJ11xbMER%2B1gVR3TdClRbq0q7YHq0GvF2rTFiLXxvrEa%2BYM4WPK5k69R9F43W6U2dzZZoGuil3Jyy4hOMwtCl%2FmSAkuHeqD%2BhJ%2Fkk7DXhbj0ifi1Wb%2BZMRaCfpOOSZpsqoJHp3n17zEHL3AuoDnaqMj8Cuf78csPF893Qy%2FDFUI%2FHQ%2FRyE2tbZdwtYHMx%2FsaOpMOTdvy%2F4rSJX8s4eOSLxt4D99%2BPye6m7mOVXIjOmDeNAh386PwgbSHEWYsz4jRbEB1Z3nNOacUlnGWD6jRnRvKLh%2F9biLZuTy8OEOpBH7fXSfzj8CNtJYSngBWnPwT%2FH4D0J8RgUIoIeXyYw%3D%3D"},{"description":{"content":"

[Optional] When the next token is specified for pagination, the same token can be used to retrieve the next page or the previous page by specifying this boolean parameter. &forward=true fetches the next page, &forward=false fetches the previous page.

\n","type":"text/plain"},"key":"forward","value":"true"},{"disabled":true,"description":{"content":"

[Optional] The dataset tasks are run initially when the dataset is created and initialized. This creates dataset execution metrics and logs - we call this iteration 0. In case there are task errors, the dataset tasks are redriven - this causes another iteration of the dataset execution that emits metrics and logs - we call this iteration 1. By default, the logs GET api lists logs for first iteration (iteration 0). In case the user is interested only in a specific dataset execution iteration, they can specify this via iteration '&iteration=' parameter.

\n","type":"text/plain"},"key":"iteration","value":"1"},{"disabled":true,"description":{"content":"

[Optional] Retrieve a task's latest execution logs by using the &tailLogs=true parameter. These will fetch the most recent logs for the task.

\n","type":"text/plain"},"key":"tailLogs","value":"true"}],"variable":[]}},"response":[{"id":"74f0ce45-7ae2-4256-9463-71e15d3f9e0c","name":"Example - View Log","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/logs?tenantId=tenantId&userId=userId&datasetName=APICreateDatasetExample1&taskId=1ce7998da2da70266a09440a6da19698&tailLogs=true","host":["https://www.letsdata.io"],"path":["api","logs"],"query":[{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner."},{"key":"datasetName","value":"APICreateDatasetExample1","description":"The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022"},{"key":"taskId","value":"1ce7998da2da70266a09440a6da19698","description":"The taskId of the task whose data we want returned. If iteration and logTokens are not specified, the logs for iteration 0 are returned by default. For example, `&taskId=01c06add9fb696bf5f69976661cedd57`"},{"key":"logToken","value":"JAqLdlc7X%2FB75IQAHk5MPefdPeiXzuPMnmJJIMPeKx7l8vCP61hImwaNo8xeMPI8%2FKLxvCweNVsuev1bqMxAViWAZUF4Pwj5%2FRtY8Y4D8Xfbxi%2FlabzBtHVl4hDnnumsfa1f49wNWkQ1sw27ySx1jF2BtgOy8Ou%2FVIBgWeqhyZXrmR7Qx8K4%2BIg3lClxI%2BtTgtNrrJ11xbMER%2B1gVR3TdClRbq0q7YHq0GvF2rTFiLXxvrEa%2BYM4WPK5k69R9F43W6U2dzZZoGuil3Jyy4hOMwtCl%2FmSAkuHeqD%2BhJ%2Fkk7DXhbj0ifi1Wb%2BZMRaCfpOOSZpsqoJHp3n17zEHL3AuoDnaqMj8Cuf78csPF893Qy%2FDFUI%2FHQ%2FRyE2tbZdwtYHMx%2FsaOpMOTdvy%2F4rSJX8s4eOSLxt4D99%2BPye6m7mOVXIjOmDeNAh386PwgbSHEWYsz4jRbEB1Z3nNOacUlnGWD6jRnRvKLh%2F9biLZuTy8OEOpBH7fXSfzj8CNtJYSngBWnPwT%2FH4D0J8RgUIoIeXyYw%3D%3D","description":"The logToken of the log we want to retrieve. These logTokens are the tokens returned by the `tasks/list` GET api and the next tokens in `logs` GET api. For example, `&logToken=AukW%2FOgg4J5lX...'","disabled":true},{"key":"forward","value":"true","description":"[Optional] When the next token is specified for pagination, the same token can be used to retrieve the next page or the previous page by specifying this boolean parameter. `&forward=true` fetches the next page, `&forward=false` fetches the previous page.","disabled":true},{"key":"iteration","value":"1","description":"[Optional] The dataset tasks are run initially when the dataset is created and initialized. This creates dataset execution metrics and logs - we call this iteration 0. In case there are task errors, the dataset tasks are redriven - this causes another iteration of the dataset execution that emits metrics and logs - we call this iteration 1. By default, the `logs` GET api lists logs for first iteration (iteration 0). In case the user is interested only in a specific dataset execution iteration, they can specify this via iteration '&iteration=' parameter.","disabled":true},{"key":"tailLogs","value":"true","description":"[Optional] Retrieve a task's latest execution logs by using the `&tailLogs=true` parameter. These will fetch the most recent logs for the task."}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 17:22:27 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"1067990"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"f93ddb73-7fb9-40cd-91d9-4c482a49a4ad"},{"key":"x-amz-apigw-id","value":"UbHczE0CIAMEByQ="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65edec51-07fa463a19a7e9c126b4a94f"}],"cookie":[],"responseTime":null,"body":"{\n \"logToken\": \"osteKzlmTnUCphgX41LQt80B2LNMLm1wSEd9YzXzjH6Yxm69uM4xeEDqIOCgcLAkxppZjhIhoH2LrfKNuFjG%2FA75Sq2H9ZldDXkeQtVdeR04wQknx6uAjhWj3KhA%2BTk2b%2BOyNm%2B1KM4g9CcNAFJVRa39eA0QlBz5w9Yyi%2FEzB2b3LHWFEnc12m%2FV9SW%2BnqLJIRU5b5diJXIWe%2F4MeAx7NUI2J4XSvuuqtWSOWPtr4eM9nLTyi2usL4U5Wrl9Cn6g0lDAaateRSnY7iUSS9o4dUAQ0mJwiauV6lBcbTvUfgeoupzv3O3c7fGhvHVGzs0Z%2BKNvdB6BWrYGsk9dfrF8JpugoG8PS23drzxm3PqtZV%2BswU0rRlW5n8u2n0XAiv1KmzgsJ3lX20V9xslgZukJQ6l7k5pe%2F46%2BudtNCU75%2BQAmWie4OUwEeLASbU2UFrSYV%2FESVhtCaWIGubwTgYCMJs3MYDM8Mt%2FS7TwMEtoaR2PDS2kgxCC3n2P%2BX3G4GHEr0rE9rzexGn6Xg1SC7zykDovIKhg94NhuFlESf3RUASJR13gNriH7zwW6JI11cRrtml8sH3vMiXmFD00Fd%2F2vBg4THr0Z7I%2BZcH4AzNqV%2FkWA4dav6SR9d53j76QzSJDGv%2BDkVCM1OhIRw2M0cUXi%2FCOuym9OAZmo17IyPF7QSYk%3D\",\n \"logs\": [\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.cabling-design.com/wireless/are-mc-and-mmx-antenna-connectors-about-the-same-15275-.htm, iterationId: 307cbea7-8dc0-4c03-bfc9-df0199f5bff2\\\",\\\"ts\\\":1710091343290,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.cabling-design.com/wireless/are-mc-and-mmx-antenna-connectors-about-the-same-15275-.htm, iterationId: 307cbea7-8dc0-4c03-bfc9-df0199f5bff2\\\",\\\"ts\\\":1710091343290,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343290}\\\",\\\"ts\\\":1710091343290,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343290}, latency: 0\\\",\\\"ts\\\":1710091343290,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.cabling-design.com/wireless/are-mc-and-mmx-antenna-connectors-about-the-same-15275-.htm, iterationId: 307cbea7-8dc0-4c03-bfc9-df0199f5bff2\\\",\\\"ts\\\":1710091343290,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.cabling-design.com/wireless/are-mc-and-mmx-antenna-connectors-about-the-same-15275-.htm, iterationId: 307cbea7-8dc0-4c03-bfc9-df0199f5bff2\\\",\\\"ts\\\":1710091343290,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343290,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.cabling-design.com/wireless/are-mc-and-mmx-antenna-connectors-about-the-same-15275-.htm, iterationId: 307cbea7-8dc0-4c03-bfc9-df0199f5bff2\\\",\\\"ts\\\":1710091343290,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 115, recordSize: 1831, indexRecordBytes: 280548\\\",\\\"ts\\\":1710091343290,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.cabling-design.com/wireless/are-mc-and-mmx-antenna-connectors-about-the-same-15275-.htm, indexRecordsCount: 116, indexRecordsBytes: 282379, numRecordsNotCheckpointed: 116, iterationId: 307cbea7-8dc0-4c03-bfc9-df0199f5bff2\\\",\\\"ts\\\":1710091343290,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.cabling-design.com/wireless/are-mc-and-mmx-antenna-connectors-about-the-same-15275-.htm, iterationId: 307cbea7-8dc0-4c03-bfc9-df0199f5bff2\\\",\\\"ts\\\":1710091343290,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343290}\\\",\\\"ts\\\":1710091343290,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343290}, latency: 0\\\",\\\"ts\\\":1710091343290,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 307cbea7-8dc0-4c03-bfc9-df0199f5bff2, iterationLatency: 12\\\",\\\"ts\\\":1710091343291,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 39f03d91-71f9-4065-8219-4637f9b631c0\\\",\\\"ts\\\":1710091343291,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343291}\\\",\\\"ts\\\":1710091343291,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343291}, latency: 0\\\",\\\"ts\\\":1710091343291,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 39f03d91-71f9-4065-8219-4637f9b631c0\\\",\\\"ts\\\":1710091343291,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091343302,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343302,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343302,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.codeblocks.org/index.php/topic,1022.255.html?PHPSESSID\\\\u003d6a6a93ac8789195688047a469a8bd225, iterationId: 39f03d91-71f9-4065-8219-4637f9b631c0\\\",\\\"ts\\\":1710091343302,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.codeblocks.org/index.php/topic,1022.255.html?PHPSESSID\\\\u003d6a6a93ac8789195688047a469a8bd225, iterationId: 39f03d91-71f9-4065-8219-4637f9b631c0\\\",\\\"ts\\\":1710091343302,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343302}\\\",\\\"ts\\\":1710091343302,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343302,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343302}, latency: 0\\\",\\\"ts\\\":1710091343302,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.codeblocks.org/index.php/topic,1022.255.html?PHPSESSID\\\\u003d6a6a93ac8789195688047a469a8bd225, iterationId: 39f03d91-71f9-4065-8219-4637f9b631c0\\\",\\\"ts\\\":1710091343302,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.codeblocks.org/index.php/topic,1022.255.html?PHPSESSID\\\\u003d6a6a93ac8789195688047a469a8bd225, iterationId: 39f03d91-71f9-4065-8219-4637f9b631c0\\\",\\\"ts\\\":1710091343302,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.codeblocks.org/index.php/topic,1022.255.html?PHPSESSID\\\\u003d6a6a93ac8789195688047a469a8bd225, iterationId: 39f03d91-71f9-4065-8219-4637f9b631c0\\\",\\\"ts\\\":1710091343303,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 116, recordSize: 3445, indexRecordBytes: 282379\\\",\\\"ts\\\":1710091343303,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.codeblocks.org/index.php/topic,1022.255.html?PHPSESSID\\\\u003d6a6a93ac8789195688047a469a8bd225, indexRecordsCount: 117, indexRecordsBytes: 285824, numRecordsNotCheckpointed: 117, iterationId: 39f03d91-71f9-4065-8219-4637f9b631c0\\\",\\\"ts\\\":1710091343303,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.codeblocks.org/index.php/topic,1022.255.html?PHPSESSID\\\\u003d6a6a93ac8789195688047a469a8bd225, iterationId: 39f03d91-71f9-4065-8219-4637f9b631c0\\\",\\\"ts\\\":1710091343303,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343303}\\\",\\\"ts\\\":1710091343303,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343303}, latency: 0\\\",\\\"ts\\\":1710091343303,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 39f03d91-71f9-4065-8219-4637f9b631c0, iterationLatency: 12\\\",\\\"ts\\\":1710091343303,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 3ce52785-b114-47fd-a5cd-714ee2ee3f82\\\",\\\"ts\\\":1710091343303,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343303}\\\",\\\"ts\\\":1710091343303,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343303}, latency: 0\\\",\\\"ts\\\":1710091343303,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 3ce52785-b114-47fd-a5cd-714ee2ee3f82\\\",\\\"ts\\\":1710091343303,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 14\\\",\\\"ts\\\":1710091343316,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.cox.com/discussions/tv/nesn-audio-and-video-out-of-sync/28244/replies/28245, iterationId: 3ce52785-b114-47fd-a5cd-714ee2ee3f82\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.cox.com/discussions/tv/nesn-audio-and-video-out-of-sync/28244/replies/28245, iterationId: 3ce52785-b114-47fd-a5cd-714ee2ee3f82\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343317}\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343317}, latency: 0\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.cox.com/discussions/tv/nesn-audio-and-video-out-of-sync/28244/replies/28245, iterationId: 3ce52785-b114-47fd-a5cd-714ee2ee3f82\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.cox.com/discussions/tv/nesn-audio-and-video-out-of-sync/28244/replies/28245, iterationId: 3ce52785-b114-47fd-a5cd-714ee2ee3f82\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.cox.com/discussions/tv/nesn-audio-and-video-out-of-sync/28244/replies/28245, iterationId: 3ce52785-b114-47fd-a5cd-714ee2ee3f82\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 117, recordSize: 1074, indexRecordBytes: 285824\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.cox.com/discussions/tv/nesn-audio-and-video-out-of-sync/28244/replies/28245, indexRecordsCount: 118, indexRecordsBytes: 286898, numRecordsNotCheckpointed: 118, iterationId: 3ce52785-b114-47fd-a5cd-714ee2ee3f82\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.cox.com/discussions/tv/nesn-audio-and-video-out-of-sync/28244/replies/28245, iterationId: 3ce52785-b114-47fd-a5cd-714ee2ee3f82\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343317}\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343317}, latency: 0\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 3ce52785-b114-47fd-a5cd-714ee2ee3f82, iterationLatency: 14\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 902591e5-cba7-47d5-92a5-1b29c6629fe1\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343317}\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343317}, latency: 0\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 902591e5-cba7-47d5-92a5-1b29c6629fe1\\\",\\\"ts\\\":1710091343317,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 8\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.cronometer.com/discussion/5496/custom-recipes, iterationId: 902591e5-cba7-47d5-92a5-1b29c6629fe1\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.cronometer.com/discussion/5496/custom-recipes, iterationId: 902591e5-cba7-47d5-92a5-1b29c6629fe1\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343326}\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343326}, latency: 0\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.cronometer.com/discussion/5496/custom-recipes, iterationId: 902591e5-cba7-47d5-92a5-1b29c6629fe1\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.cronometer.com/discussion/5496/custom-recipes, iterationId: 902591e5-cba7-47d5-92a5-1b29c6629fe1\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.cronometer.com/discussion/5496/custom-recipes, iterationId: 902591e5-cba7-47d5-92a5-1b29c6629fe1\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 118, recordSize: 919, indexRecordBytes: 286898\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.cronometer.com/discussion/5496/custom-recipes, indexRecordsCount: 119, indexRecordsBytes: 287817, numRecordsNotCheckpointed: 119, iterationId: 902591e5-cba7-47d5-92a5-1b29c6629fe1\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.cronometer.com/discussion/5496/custom-recipes, iterationId: 902591e5-cba7-47d5-92a5-1b29c6629fe1\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343326}\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343326}, latency: 0\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 902591e5-cba7-47d5-92a5-1b29c6629fe1, iterationLatency: 9\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: e1c254c7-a754-4583-8756-52c61ade8cba\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343326}\\\",\\\"ts\\\":1710091343326,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343326}, latency: 0\\\",\\\"ts\\\":1710091343327,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: e1c254c7-a754-4583-8756-52c61ade8cba\\\",\\\"ts\\\":1710091343327,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091343337,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343337,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343337,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.cronometer.com/profile/honeypig, iterationId: e1c254c7-a754-4583-8756-52c61ade8cba\\\",\\\"ts\\\":1710091343337,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.cronometer.com/profile/honeypig, iterationId: e1c254c7-a754-4583-8756-52c61ade8cba\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343338}\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343338}, latency: 0\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.cronometer.com/profile/honeypig, iterationId: e1c254c7-a754-4583-8756-52c61ade8cba\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.cronometer.com/profile/honeypig, iterationId: e1c254c7-a754-4583-8756-52c61ade8cba\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.cronometer.com/profile/honeypig, iterationId: e1c254c7-a754-4583-8756-52c61ade8cba\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 119, recordSize: 532, indexRecordBytes: 287817\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.cronometer.com/profile/honeypig, indexRecordsCount: 120, indexRecordsBytes: 288349, numRecordsNotCheckpointed: 120, iterationId: e1c254c7-a754-4583-8756-52c61ade8cba\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.cronometer.com/profile/honeypig, iterationId: e1c254c7-a754-4583-8756-52c61ade8cba\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343338}\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343338}, latency: 0\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: e1c254c7-a754-4583-8756-52c61ade8cba, iterationLatency: 12\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: d7a71bd2-55b6-4c53-aeb3-615f5b5108f3\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343338}\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343338}, latency: 0\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: d7a71bd2-55b6-4c53-aeb3-615f5b5108f3\\\",\\\"ts\\\":1710091343338,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091343349,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343350,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343350,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343350,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.cybernations.net/topic/46906-announcement-from-the-north-atlantic-defense-coalition/, iterationId: d7a71bd2-55b6-4c53-aeb3-615f5b5108f3\\\",\\\"ts\\\":1710091343351,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.cybernations.net/topic/46906-announcement-from-the-north-atlantic-defense-coalition/, iterationId: d7a71bd2-55b6-4c53-aeb3-615f5b5108f3\\\",\\\"ts\\\":1710091343351,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343351}\\\",\\\"ts\\\":1710091343351,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343351}, latency: 0\\\",\\\"ts\\\":1710091343351,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.cybernations.net/topic/46906-announcement-from-the-north-atlantic-defense-coalition/, iterationId: d7a71bd2-55b6-4c53-aeb3-615f5b5108f3\\\",\\\"ts\\\":1710091343351,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.cybernations.net/topic/46906-announcement-from-the-north-atlantic-defense-coalition/, iterationId: d7a71bd2-55b6-4c53-aeb3-615f5b5108f3\\\",\\\"ts\\\":1710091343351,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.cybernations.net/topic/46906-announcement-from-the-north-atlantic-defense-coalition/, iterationId: d7a71bd2-55b6-4c53-aeb3-615f5b5108f3\\\",\\\"ts\\\":1710091343352,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 120, recordSize: 3002, indexRecordBytes: 288349\\\",\\\"ts\\\":1710091343352,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.cybernations.net/topic/46906-announcement-from-the-north-atlantic-defense-coalition/, indexRecordsCount: 121, indexRecordsBytes: 291351, numRecordsNotCheckpointed: 121, iterationId: d7a71bd2-55b6-4c53-aeb3-615f5b5108f3\\\",\\\"ts\\\":1710091343352,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.cybernations.net/topic/46906-announcement-from-the-north-atlantic-defense-coalition/, iterationId: d7a71bd2-55b6-4c53-aeb3-615f5b5108f3\\\",\\\"ts\\\":1710091343352,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343352}\\\",\\\"ts\\\":1710091343352,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343352}, latency: 0\\\",\\\"ts\\\":1710091343352,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: d7a71bd2-55b6-4c53-aeb3-615f5b5108f3, iterationLatency: 14\\\",\\\"ts\\\":1710091343352,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: ccd74b0c-6a34-448e-9cb1-1f4155e5b234\\\",\\\"ts\\\":1710091343352,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343352}\\\",\\\"ts\\\":1710091343352,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343352}, latency: 0\\\",\\\"ts\\\":1710091343352,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: ccd74b0c-6a34-448e-9cb1-1f4155e5b234\\\",\\\"ts\\\":1710091343352,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091343363,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343363,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343363,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.cybernations.net/topic/61812-operation-bug-squash/, iterationId: ccd74b0c-6a34-448e-9cb1-1f4155e5b234\\\",\\\"ts\\\":1710091343363,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.cybernations.net/topic/61812-operation-bug-squash/, iterationId: ccd74b0c-6a34-448e-9cb1-1f4155e5b234\\\",\\\"ts\\\":1710091343363,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343363,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343363}\\\",\\\"ts\\\":1710091343363,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343363}, latency: 0\\\",\\\"ts\\\":1710091343363,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.cybernations.net/topic/61812-operation-bug-squash/, iterationId: ccd74b0c-6a34-448e-9cb1-1f4155e5b234\\\",\\\"ts\\\":1710091343363,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.cybernations.net/topic/61812-operation-bug-squash/, iterationId: ccd74b0c-6a34-448e-9cb1-1f4155e5b234\\\",\\\"ts\\\":1710091343363,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.cybernations.net/topic/61812-operation-bug-squash/, iterationId: ccd74b0c-6a34-448e-9cb1-1f4155e5b234\\\",\\\"ts\\\":1710091343364,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 121, recordSize: 3452, indexRecordBytes: 291351\\\",\\\"ts\\\":1710091343364,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.cybernations.net/topic/61812-operation-bug-squash/, indexRecordsCount: 122, indexRecordsBytes: 294803, numRecordsNotCheckpointed: 122, iterationId: ccd74b0c-6a34-448e-9cb1-1f4155e5b234\\\",\\\"ts\\\":1710091343364,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.cybernations.net/topic/61812-operation-bug-squash/, iterationId: ccd74b0c-6a34-448e-9cb1-1f4155e5b234\\\",\\\"ts\\\":1710091343364,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343364}\\\",\\\"ts\\\":1710091343364,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343364}, latency: 0\\\",\\\"ts\\\":1710091343364,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: ccd74b0c-6a34-448e-9cb1-1f4155e5b234, iterationLatency: 12\\\",\\\"ts\\\":1710091343364,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 966fdc9e-50cc-4b05-9a2d-ac4d3cf8b413\\\",\\\"ts\\\":1710091343364,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343364}\\\",\\\"ts\\\":1710091343364,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343364}, latency: 0\\\",\\\"ts\\\":1710091343364,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 966fdc9e-50cc-4b05-9a2d-ac4d3cf8b413\\\",\\\"ts\\\":1710091343364,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 9\\\",\\\"ts\\\":1710091343372,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343372,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343372,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.daybreakgames.com/dcuo/index.php?threads/doctor-fates-daily-rewards-may-2023.327765/#post-4579910, iterationId: 966fdc9e-50cc-4b05-9a2d-ac4d3cf8b413\\\",\\\"ts\\\":1710091343372,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.daybreakgames.com/dcuo/index.php?threads/doctor-fates-daily-rewards-may-2023.327765/#post-4579910, iterationId: 966fdc9e-50cc-4b05-9a2d-ac4d3cf8b413\\\",\\\"ts\\\":1710091343372,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343372,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343372}\\\",\\\"ts\\\":1710091343372,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343372}, latency: 0\\\",\\\"ts\\\":1710091343373,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.daybreakgames.com/dcuo/index.php?threads/doctor-fates-daily-rewards-may-2023.327765/#post-4579910, iterationId: 966fdc9e-50cc-4b05-9a2d-ac4d3cf8b413\\\",\\\"ts\\\":1710091343373,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.daybreakgames.com/dcuo/index.php?threads/doctor-fates-daily-rewards-may-2023.327765/#post-4579910, iterationId: 966fdc9e-50cc-4b05-9a2d-ac4d3cf8b413\\\",\\\"ts\\\":1710091343373,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.daybreakgames.com/dcuo/index.php?threads/doctor-fates-daily-rewards-may-2023.327765/#post-4579910, iterationId: 966fdc9e-50cc-4b05-9a2d-ac4d3cf8b413\\\",\\\"ts\\\":1710091343373,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 122, recordSize: 2633, indexRecordBytes: 294803\\\",\\\"ts\\\":1710091343373,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.daybreakgames.com/dcuo/index.php?threads/doctor-fates-daily-rewards-may-2023.327765/#post-4579910, indexRecordsCount: 123, indexRecordsBytes: 297436, numRecordsNotCheckpointed: 123, iterationId: 966fdc9e-50cc-4b05-9a2d-ac4d3cf8b413\\\",\\\"ts\\\":1710091343373,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.daybreakgames.com/dcuo/index.php?threads/doctor-fates-daily-rewards-may-2023.327765/#post-4579910, iterationId: 966fdc9e-50cc-4b05-9a2d-ac4d3cf8b413\\\",\\\"ts\\\":1710091343373,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343373}\\\",\\\"ts\\\":1710091343373,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343373}, latency: 0\\\",\\\"ts\\\":1710091343373,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 966fdc9e-50cc-4b05-9a2d-ac4d3cf8b413, iterationLatency: 9\\\",\\\"ts\\\":1710091343373,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: b6700793-174d-4584-8e51-167b202d1c35\\\",\\\"ts\\\":1710091343373,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343373}\\\",\\\"ts\\\":1710091343373,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343373}, latency: 0\\\",\\\"ts\\\":1710091343373,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: b6700793-174d-4584-8e51-167b202d1c35\\\",\\\"ts\\\":1710091343373,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 10\\\",\\\"ts\\\":1710091343383,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343383,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343383,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.elementalgame.com/karma/given/23, iterationId: b6700793-174d-4584-8e51-167b202d1c35\\\",\\\"ts\\\":1710091343383,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.elementalgame.com/karma/given/23, iterationId: b6700793-174d-4584-8e51-167b202d1c35\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343384}\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343384}, latency: 0\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.elementalgame.com/karma/given/23, iterationId: b6700793-174d-4584-8e51-167b202d1c35\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.elementalgame.com/karma/given/23, iterationId: b6700793-174d-4584-8e51-167b202d1c35\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.elementalgame.com/karma/given/23, iterationId: b6700793-174d-4584-8e51-167b202d1c35\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 123, recordSize: 2221, indexRecordBytes: 297436\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.elementalgame.com/karma/given/23, indexRecordsCount: 124, indexRecordsBytes: 299657, numRecordsNotCheckpointed: 124, iterationId: b6700793-174d-4584-8e51-167b202d1c35\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.elementalgame.com/karma/given/23, iterationId: b6700793-174d-4584-8e51-167b202d1c35\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343384}\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343384}, latency: 0\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: b6700793-174d-4584-8e51-167b202d1c35, iterationLatency: 11\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: e8266f1d-c5b4-4b7d-bd1f-b0f8c3355b87\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343384}\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343384}, latency: 0\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: e8266f1d-c5b4-4b7d-bd1f-b0f8c3355b87\\\",\\\"ts\\\":1710091343384,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091343396,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343396,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343396,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.episodeinteractive.com/t/i-need-emote-helpppp/510588, iterationId: e8266f1d-c5b4-4b7d-bd1f-b0f8c3355b87\\\",\\\"ts\\\":1710091343396,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.episodeinteractive.com/t/i-need-emote-helpppp/510588, iterationId: e8266f1d-c5b4-4b7d-bd1f-b0f8c3355b87\\\",\\\"ts\\\":1710091343396,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343396}\\\",\\\"ts\\\":1710091343396,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343396,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343396}, latency: 0\\\",\\\"ts\\\":1710091343396,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.episodeinteractive.com/t/i-need-emote-helpppp/510588, iterationId: e8266f1d-c5b4-4b7d-bd1f-b0f8c3355b87\\\",\\\"ts\\\":1710091343396,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.episodeinteractive.com/t/i-need-emote-helpppp/510588, iterationId: e8266f1d-c5b4-4b7d-bd1f-b0f8c3355b87\\\",\\\"ts\\\":1710091343396,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.episodeinteractive.com/t/i-need-emote-helpppp/510588, iterationId: e8266f1d-c5b4-4b7d-bd1f-b0f8c3355b87\\\",\\\"ts\\\":1710091343396,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 124, recordSize: 920, indexRecordBytes: 299657\\\",\\\"ts\\\":1710091343396,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.episodeinteractive.com/t/i-need-emote-helpppp/510588, indexRecordsCount: 125, indexRecordsBytes: 300577, numRecordsNotCheckpointed: 125, iterationId: e8266f1d-c5b4-4b7d-bd1f-b0f8c3355b87\\\",\\\"ts\\\":1710091343397,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.episodeinteractive.com/t/i-need-emote-helpppp/510588, iterationId: e8266f1d-c5b4-4b7d-bd1f-b0f8c3355b87\\\",\\\"ts\\\":1710091343397,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343397}\\\",\\\"ts\\\":1710091343397,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343397}, latency: 0\\\",\\\"ts\\\":1710091343397,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: e8266f1d-c5b4-4b7d-bd1f-b0f8c3355b87, iterationLatency: 13\\\",\\\"ts\\\":1710091343397,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: a89fdaed-3b6f-4d42-84d7-53c27aa3e601\\\",\\\"ts\\\":1710091343397,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343397}\\\",\\\"ts\\\":1710091343397,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343397}, latency: 0\\\",\\\"ts\\\":1710091343397,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: a89fdaed-3b6f-4d42-84d7-53c27aa3e601\\\",\\\"ts\\\":1710091343397,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 10\\\",\\\"ts\\\":1710091343406,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343406,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343406,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.footballguys.com/threads/10-team-league-ppr-draft-friday-need-one-owner.768093/, iterationId: a89fdaed-3b6f-4d42-84d7-53c27aa3e601\\\",\\\"ts\\\":1710091343406,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.footballguys.com/threads/10-team-league-ppr-draft-friday-need-one-owner.768093/, iterationId: a89fdaed-3b6f-4d42-84d7-53c27aa3e601\\\",\\\"ts\\\":1710091343406,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343406}\\\",\\\"ts\\\":1710091343406,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343406}, latency: 0\\\",\\\"ts\\\":1710091343406,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343406,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.footballguys.com/threads/10-team-league-ppr-draft-friday-need-one-owner.768093/, iterationId: a89fdaed-3b6f-4d42-84d7-53c27aa3e601\\\",\\\"ts\\\":1710091343406,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.footballguys.com/threads/10-team-league-ppr-draft-friday-need-one-owner.768093/, iterationId: a89fdaed-3b6f-4d42-84d7-53c27aa3e601\\\",\\\"ts\\\":1710091343406,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.footballguys.com/threads/10-team-league-ppr-draft-friday-need-one-owner.768093/, iterationId: a89fdaed-3b6f-4d42-84d7-53c27aa3e601\\\",\\\"ts\\\":1710091343406,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 125, recordSize: 1577, indexRecordBytes: 300577\\\",\\\"ts\\\":1710091343407,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.footballguys.com/threads/10-team-league-ppr-draft-friday-need-one-owner.768093/, indexRecordsCount: 126, indexRecordsBytes: 302154, numRecordsNotCheckpointed: 126, iterationId: a89fdaed-3b6f-4d42-84d7-53c27aa3e601\\\",\\\"ts\\\":1710091343407,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.footballguys.com/threads/10-team-league-ppr-draft-friday-need-one-owner.768093/, iterationId: a89fdaed-3b6f-4d42-84d7-53c27aa3e601\\\",\\\"ts\\\":1710091343407,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343407}\\\",\\\"ts\\\":1710091343407,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343407}, latency: 0\\\",\\\"ts\\\":1710091343407,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: a89fdaed-3b6f-4d42-84d7-53c27aa3e601, iterationLatency: 10\\\",\\\"ts\\\":1710091343407,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: d516a967-39aa-40ea-872b-8f71d663588b\\\",\\\"ts\\\":1710091343407,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343407}\\\",\\\"ts\\\":1710091343407,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343407}, latency: 0\\\",\\\"ts\\\":1710091343407,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: d516a967-39aa-40ea-872b-8f71d663588b\\\",\\\"ts\\\":1710091343407,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 14\\\",\\\"ts\\\":1710091343420,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343420,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343420,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.footballguys.com/threads/carson-palmer.218314/, iterationId: d516a967-39aa-40ea-872b-8f71d663588b\\\",\\\"ts\\\":1710091343420,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343420,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.footballguys.com/threads/carson-palmer.218314/, iterationId: d516a967-39aa-40ea-872b-8f71d663588b\\\",\\\"ts\\\":1710091343420,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343420}\\\",\\\"ts\\\":1710091343420,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343420}, latency: 0\\\",\\\"ts\\\":1710091343420,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.footballguys.com/threads/carson-palmer.218314/, iterationId: d516a967-39aa-40ea-872b-8f71d663588b\\\",\\\"ts\\\":1710091343421,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.footballguys.com/threads/carson-palmer.218314/, iterationId: d516a967-39aa-40ea-872b-8f71d663588b\\\",\\\"ts\\\":1710091343421,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.footballguys.com/threads/carson-palmer.218314/, iterationId: d516a967-39aa-40ea-872b-8f71d663588b\\\",\\\"ts\\\":1710091343421,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 126, recordSize: 2472, indexRecordBytes: 302154\\\",\\\"ts\\\":1710091343421,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.footballguys.com/threads/carson-palmer.218314/, indexRecordsCount: 127, indexRecordsBytes: 304626, numRecordsNotCheckpointed: 127, iterationId: d516a967-39aa-40ea-872b-8f71d663588b\\\",\\\"ts\\\":1710091343421,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.footballguys.com/threads/carson-palmer.218314/, iterationId: d516a967-39aa-40ea-872b-8f71d663588b\\\",\\\"ts\\\":1710091343421,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343421}\\\",\\\"ts\\\":1710091343421,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343421}, latency: 0\\\",\\\"ts\\\":1710091343421,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: d516a967-39aa-40ea-872b-8f71d663588b, iterationLatency: 14\\\",\\\"ts\\\":1710091343421,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 36e4f400-be97-4d39-a50b-b9a871414632\\\",\\\"ts\\\":1710091343421,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343421}\\\",\\\"ts\\\":1710091343421,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343421}, latency: 0\\\",\\\"ts\\\":1710091343421,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 36e4f400-be97-4d39-a50b-b9a871414632\\\",\\\"ts\\\":1710091343421,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 17\\\",\\\"ts\\\":1710091343438,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343438,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343438,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.footballguys.com/threads/idp-dynasty-league-opening.774059/, iterationId: 36e4f400-be97-4d39-a50b-b9a871414632\\\",\\\"ts\\\":1710091343438,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.footballguys.com/threads/idp-dynasty-league-opening.774059/, iterationId: 36e4f400-be97-4d39-a50b-b9a871414632\\\",\\\"ts\\\":1710091343438,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343438}\\\",\\\"ts\\\":1710091343438,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343438}, latency: 0\\\",\\\"ts\\\":1710091343438,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.footballguys.com/threads/idp-dynasty-league-opening.774059/, iterationId: 36e4f400-be97-4d39-a50b-b9a871414632\\\",\\\"ts\\\":1710091343438,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.footballguys.com/threads/idp-dynasty-league-opening.774059/, iterationId: 36e4f400-be97-4d39-a50b-b9a871414632\\\",\\\"ts\\\":1710091343438,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343438,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.footballguys.com/threads/idp-dynasty-league-opening.774059/, iterationId: 36e4f400-be97-4d39-a50b-b9a871414632\\\",\\\"ts\\\":1710091343438,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 127, recordSize: 1865, indexRecordBytes: 304626\\\",\\\"ts\\\":1710091343439,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.footballguys.com/threads/idp-dynasty-league-opening.774059/, indexRecordsCount: 128, indexRecordsBytes: 306491, numRecordsNotCheckpointed: 128, iterationId: 36e4f400-be97-4d39-a50b-b9a871414632\\\",\\\"ts\\\":1710091343439,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.footballguys.com/threads/idp-dynasty-league-opening.774059/, iterationId: 36e4f400-be97-4d39-a50b-b9a871414632\\\",\\\"ts\\\":1710091343439,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343439}\\\",\\\"ts\\\":1710091343439,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343439}, latency: 0\\\",\\\"ts\\\":1710091343439,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 36e4f400-be97-4d39-a50b-b9a871414632, iterationLatency: 18\\\",\\\"ts\\\":1710091343439,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 8f809856-5ff4-4dfb-82dd-4222f7ededfd\\\",\\\"ts\\\":1710091343439,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343439}\\\",\\\"ts\\\":1710091343439,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343439}, latency: 0\\\",\\\"ts\\\":1710091343439,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 8f809856-5ff4-4dfb-82dd-4222f7ededfd\\\",\\\"ts\\\":1710091343439,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091343450,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343450,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343450,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.footballguys.com/threads/jamarcus-russell.440033/, iterationId: 8f809856-5ff4-4dfb-82dd-4222f7ededfd\\\",\\\"ts\\\":1710091343450,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.footballguys.com/threads/jamarcus-russell.440033/, iterationId: 8f809856-5ff4-4dfb-82dd-4222f7ededfd\\\",\\\"ts\\\":1710091343450,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343450}\\\",\\\"ts\\\":1710091343450,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343450}, latency: 0\\\",\\\"ts\\\":1710091343450,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.footballguys.com/threads/jamarcus-russell.440033/, iterationId: 8f809856-5ff4-4dfb-82dd-4222f7ededfd\\\",\\\"ts\\\":1710091343450,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.footballguys.com/threads/jamarcus-russell.440033/, iterationId: 8f809856-5ff4-4dfb-82dd-4222f7ededfd\\\",\\\"ts\\\":1710091343450,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343450,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.footballguys.com/threads/jamarcus-russell.440033/, iterationId: 8f809856-5ff4-4dfb-82dd-4222f7ededfd\\\",\\\"ts\\\":1710091343451,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 128, recordSize: 4010, indexRecordBytes: 306491\\\",\\\"ts\\\":1710091343451,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.footballguys.com/threads/jamarcus-russell.440033/, indexRecordsCount: 129, indexRecordsBytes: 310501, numRecordsNotCheckpointed: 129, iterationId: 8f809856-5ff4-4dfb-82dd-4222f7ededfd\\\",\\\"ts\\\":1710091343451,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.footballguys.com/threads/jamarcus-russell.440033/, iterationId: 8f809856-5ff4-4dfb-82dd-4222f7ededfd\\\",\\\"ts\\\":1710091343451,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343451}\\\",\\\"ts\\\":1710091343451,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343451}, latency: 0\\\",\\\"ts\\\":1710091343451,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 8f809856-5ff4-4dfb-82dd-4222f7ededfd, iterationLatency: 12\\\",\\\"ts\\\":1710091343451,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: ea500fef-0514-4d3f-905b-5a6bd3da8034\\\",\\\"ts\\\":1710091343451,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343451}\\\",\\\"ts\\\":1710091343451,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343451}, latency: 0\\\",\\\"ts\\\":1710091343451,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: ea500fef-0514-4d3f-905b-5a6bd3da8034\\\",\\\"ts\\\":1710091343451,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 14\\\",\\\"ts\\\":1710091343464,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343464,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343464,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.footballguys.com/threads/keeper-kelce-or-goodwin.769112/, iterationId: ea500fef-0514-4d3f-905b-5a6bd3da8034\\\",\\\"ts\\\":1710091343464,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.footballguys.com/threads/keeper-kelce-or-goodwin.769112/, iterationId: ea500fef-0514-4d3f-905b-5a6bd3da8034\\\",\\\"ts\\\":1710091343464,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343464}\\\",\\\"ts\\\":1710091343464,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343464}, latency: 0\\\",\\\"ts\\\":1710091343465,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.footballguys.com/threads/keeper-kelce-or-goodwin.769112/, iterationId: ea500fef-0514-4d3f-905b-5a6bd3da8034\\\",\\\"ts\\\":1710091343465,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.footballguys.com/threads/keeper-kelce-or-goodwin.769112/, iterationId: ea500fef-0514-4d3f-905b-5a6bd3da8034\\\",\\\"ts\\\":1710091343465,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.footballguys.com/threads/keeper-kelce-or-goodwin.769112/, iterationId: ea500fef-0514-4d3f-905b-5a6bd3da8034\\\",\\\"ts\\\":1710091343465,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 129, recordSize: 1825, indexRecordBytes: 310501\\\",\\\"ts\\\":1710091343465,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.footballguys.com/threads/keeper-kelce-or-goodwin.769112/, indexRecordsCount: 130, indexRecordsBytes: 312326, numRecordsNotCheckpointed: 130, iterationId: ea500fef-0514-4d3f-905b-5a6bd3da8034\\\",\\\"ts\\\":1710091343465,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.footballguys.com/threads/keeper-kelce-or-goodwin.769112/, iterationId: ea500fef-0514-4d3f-905b-5a6bd3da8034\\\",\\\"ts\\\":1710091343465,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343465,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343465}\\\",\\\"ts\\\":1710091343465,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343465}, latency: 0\\\",\\\"ts\\\":1710091343465,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: ea500fef-0514-4d3f-905b-5a6bd3da8034, iterationLatency: 14\\\",\\\"ts\\\":1710091343465,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: e492a2b4-a2f5-4339-a2ea-27139093b476\\\",\\\"ts\\\":1710091343465,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343465}\\\",\\\"ts\\\":1710091343465,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343465}, latency: 0\\\",\\\"ts\\\":1710091343465,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: e492a2b4-a2f5-4339-a2ea-27139093b476\\\",\\\"ts\\\":1710091343465,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 14\\\",\\\"ts\\\":1710091343479,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343479,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343480,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.footballguys.com/threads/qb-daniel-jones-nyg.773699/, iterationId: e492a2b4-a2f5-4339-a2ea-27139093b476\\\",\\\"ts\\\":1710091343480,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343480,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.footballguys.com/threads/qb-daniel-jones-nyg.773699/, iterationId: e492a2b4-a2f5-4339-a2ea-27139093b476\\\",\\\"ts\\\":1710091343480,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343480}\\\",\\\"ts\\\":1710091343480,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343480}, latency: 0\\\",\\\"ts\\\":1710091343480,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.footballguys.com/threads/qb-daniel-jones-nyg.773699/, iterationId: e492a2b4-a2f5-4339-a2ea-27139093b476\\\",\\\"ts\\\":1710091343480,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.footballguys.com/threads/qb-daniel-jones-nyg.773699/, iterationId: e492a2b4-a2f5-4339-a2ea-27139093b476\\\",\\\"ts\\\":1710091343480,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.footballguys.com/threads/qb-daniel-jones-nyg.773699/, iterationId: e492a2b4-a2f5-4339-a2ea-27139093b476\\\",\\\"ts\\\":1710091343482,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 130, recordSize: 11177, indexRecordBytes: 312326\\\",\\\"ts\\\":1710091343482,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.footballguys.com/threads/qb-daniel-jones-nyg.773699/, indexRecordsCount: 131, indexRecordsBytes: 323503, numRecordsNotCheckpointed: 131, iterationId: e492a2b4-a2f5-4339-a2ea-27139093b476\\\",\\\"ts\\\":1710091343482,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.footballguys.com/threads/qb-daniel-jones-nyg.773699/, iterationId: e492a2b4-a2f5-4339-a2ea-27139093b476\\\",\\\"ts\\\":1710091343482,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343482}\\\",\\\"ts\\\":1710091343482,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343482}, latency: 0\\\",\\\"ts\\\":1710091343482,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: e492a2b4-a2f5-4339-a2ea-27139093b476, iterationLatency: 17\\\",\\\"ts\\\":1710091343482,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 1f64704d-5cb9-4415-9dc2-d08fefb133eb\\\",\\\"ts\\\":1710091343482,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343482}\\\",\\\"ts\\\":1710091343482,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343482}, latency: 0\\\",\\\"ts\\\":1710091343482,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 1f64704d-5cb9-4415-9dc2-d08fefb133eb\\\",\\\"ts\\\":1710091343482,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091343491,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.footballguys.com/threads/shanghai-recommendations-for-1st-timer.773159/, iterationId: 1f64704d-5cb9-4415-9dc2-d08fefb133eb\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.footballguys.com/threads/shanghai-recommendations-for-1st-timer.773159/, iterationId: 1f64704d-5cb9-4415-9dc2-d08fefb133eb\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343492}\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343492}, latency: 0\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.footballguys.com/threads/shanghai-recommendations-for-1st-timer.773159/, iterationId: 1f64704d-5cb9-4415-9dc2-d08fefb133eb\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.footballguys.com/threads/shanghai-recommendations-for-1st-timer.773159/, iterationId: 1f64704d-5cb9-4415-9dc2-d08fefb133eb\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.footballguys.com/threads/shanghai-recommendations-for-1st-timer.773159/, iterationId: 1f64704d-5cb9-4415-9dc2-d08fefb133eb\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 131, recordSize: 2181, indexRecordBytes: 323503\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.footballguys.com/threads/shanghai-recommendations-for-1st-timer.773159/, indexRecordsCount: 132, indexRecordsBytes: 325684, numRecordsNotCheckpointed: 132, iterationId: 1f64704d-5cb9-4415-9dc2-d08fefb133eb\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.footballguys.com/threads/shanghai-recommendations-for-1st-timer.773159/, iterationId: 1f64704d-5cb9-4415-9dc2-d08fefb133eb\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343492}\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343492}, latency: 0\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 1f64704d-5cb9-4415-9dc2-d08fefb133eb, iterationLatency: 10\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 9d486622-c09d-4462-a38a-5d6606b0236e\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343492}\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343492}, latency: 0\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 9d486622-c09d-4462-a38a-5d6606b0236e\\\",\\\"ts\\\":1710091343492,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 15\\\",\\\"ts\\\":1710091343508,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343508,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343508,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.galciv3.com/454429/page/1/#3468911, iterationId: 9d486622-c09d-4462-a38a-5d6606b0236e\\\",\\\"ts\\\":1710091343508,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.galciv3.com/454429/page/1/#3468911, iterationId: 9d486622-c09d-4462-a38a-5d6606b0236e\\\",\\\"ts\\\":1710091343508,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343508}\\\",\\\"ts\\\":1710091343508,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343508}, latency: 0\\\",\\\"ts\\\":1710091343508,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343508,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.galciv3.com/454429/page/1/#3468911, iterationId: 9d486622-c09d-4462-a38a-5d6606b0236e\\\",\\\"ts\\\":1710091343508,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.galciv3.com/454429/page/1/#3468911, iterationId: 9d486622-c09d-4462-a38a-5d6606b0236e\\\",\\\"ts\\\":1710091343508,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.galciv3.com/454429/page/1/#3468911, iterationId: 9d486622-c09d-4462-a38a-5d6606b0236e\\\",\\\"ts\\\":1710091343509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 132, recordSize: 5562, indexRecordBytes: 325684\\\",\\\"ts\\\":1710091343509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.galciv3.com/454429/page/1/#3468911, indexRecordsCount: 133, indexRecordsBytes: 331246, numRecordsNotCheckpointed: 133, iterationId: 9d486622-c09d-4462-a38a-5d6606b0236e\\\",\\\"ts\\\":1710091343509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.galciv3.com/454429/page/1/#3468911, iterationId: 9d486622-c09d-4462-a38a-5d6606b0236e\\\",\\\"ts\\\":1710091343509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343509}\\\",\\\"ts\\\":1710091343509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343509}, latency: 0\\\",\\\"ts\\\":1710091343509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 9d486622-c09d-4462-a38a-5d6606b0236e, iterationLatency: 17\\\",\\\"ts\\\":1710091343509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 324d8eb3-c8ad-4b19-aca1-ebfc5f6b3ee2\\\",\\\"ts\\\":1710091343509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343509}\\\",\\\"ts\\\":1710091343509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343509}, latency: 0\\\",\\\"ts\\\":1710091343509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 324d8eb3-c8ad-4b19-aca1-ebfc5f6b3ee2\\\",\\\"ts\\\":1710091343509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091343520,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.garmin.com/sports-fitness/running-multisport/f/forerunner-935/153198/indoor-rowing---best-way-to-sync-with-concept2/878489, iterationId: 324d8eb3-c8ad-4b19-aca1-ebfc5f6b3ee2\\\",\\\"ts\\\":1710091343520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.garmin.com/sports-fitness/running-multisport/f/forerunner-935/153198/indoor-rowing---best-way-to-sync-with-concept2/878489, iterationId: 324d8eb3-c8ad-4b19-aca1-ebfc5f6b3ee2\\\",\\\"ts\\\":1710091343520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343520}\\\",\\\"ts\\\":1710091343520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343520,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343520}, latency: 0\\\",\\\"ts\\\":1710091343520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.garmin.com/sports-fitness/running-multisport/f/forerunner-935/153198/indoor-rowing---best-way-to-sync-with-concept2/878489, iterationId: 324d8eb3-c8ad-4b19-aca1-ebfc5f6b3ee2\\\",\\\"ts\\\":1710091343520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.garmin.com/sports-fitness/running-multisport/f/forerunner-935/153198/indoor-rowing---best-way-to-sync-with-concept2/878489, iterationId: 324d8eb3-c8ad-4b19-aca1-ebfc5f6b3ee2\\\",\\\"ts\\\":1710091343520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.garmin.com/sports-fitness/running-multisport/f/forerunner-935/153198/indoor-rowing---best-way-to-sync-with-concept2/878489, iterationId: 324d8eb3-c8ad-4b19-aca1-ebfc5f6b3ee2\\\",\\\"ts\\\":1710091343521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 133, recordSize: 3686, indexRecordBytes: 331246\\\",\\\"ts\\\":1710091343521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.garmin.com/sports-fitness/running-multisport/f/forerunner-935/153198/indoor-rowing---best-way-to-sync-with-concept2/878489, indexRecordsCount: 134, indexRecordsBytes: 334932, numRecordsNotCheckpointed: 134, iterationId: 324d8eb3-c8ad-4b19-aca1-ebfc5f6b3ee2\\\",\\\"ts\\\":1710091343521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.garmin.com/sports-fitness/running-multisport/f/forerunner-935/153198/indoor-rowing---best-way-to-sync-with-concept2/878489, iterationId: 324d8eb3-c8ad-4b19-aca1-ebfc5f6b3ee2\\\",\\\"ts\\\":1710091343521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343521}\\\",\\\"ts\\\":1710091343521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343521}, latency: 0\\\",\\\"ts\\\":1710091343521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 324d8eb3-c8ad-4b19-aca1-ebfc5f6b3ee2, iterationLatency: 12\\\",\\\"ts\\\":1710091343521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: fdad3ea2-eb31-4ff9-b52e-8ed736417483\\\",\\\"ts\\\":1710091343521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343521}\\\",\\\"ts\\\":1710091343521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343521}, latency: 0\\\",\\\"ts\\\":1710091343521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: fdad3ea2-eb31-4ff9-b52e-8ed736417483\\\",\\\"ts\\\":1710091343521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 10\\\",\\\"ts\\\":1710091343530,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343530,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343530,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.gentoo.org/viewforum-f-18.html?sid\\\\u003db64844c0f5e44e658b57307f96ac5b8a, iterationId: fdad3ea2-eb31-4ff9-b52e-8ed736417483\\\",\\\"ts\\\":1710091343530,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343530,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.gentoo.org/viewforum-f-18.html?sid\\\\u003db64844c0f5e44e658b57307f96ac5b8a, iterationId: fdad3ea2-eb31-4ff9-b52e-8ed736417483\\\",\\\"ts\\\":1710091343530,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343530}\\\",\\\"ts\\\":1710091343530,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343530}, latency: 0\\\",\\\"ts\\\":1710091343530,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.gentoo.org/viewforum-f-18.html?sid\\\\u003db64844c0f5e44e658b57307f96ac5b8a, iterationId: fdad3ea2-eb31-4ff9-b52e-8ed736417483\\\",\\\"ts\\\":1710091343530,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.gentoo.org/viewforum-f-18.html?sid\\\\u003db64844c0f5e44e658b57307f96ac5b8a, iterationId: fdad3ea2-eb31-4ff9-b52e-8ed736417483\\\",\\\"ts\\\":1710091343530,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.gentoo.org/viewforum-f-18.html?sid\\\\u003db64844c0f5e44e658b57307f96ac5b8a, iterationId: fdad3ea2-eb31-4ff9-b52e-8ed736417483\\\",\\\"ts\\\":1710091343531,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 134, recordSize: 3935, indexRecordBytes: 334932\\\",\\\"ts\\\":1710091343531,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.gentoo.org/viewforum-f-18.html?sid\\\\u003db64844c0f5e44e658b57307f96ac5b8a, indexRecordsCount: 135, indexRecordsBytes: 338867, numRecordsNotCheckpointed: 135, iterationId: fdad3ea2-eb31-4ff9-b52e-8ed736417483\\\",\\\"ts\\\":1710091343531,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.gentoo.org/viewforum-f-18.html?sid\\\\u003db64844c0f5e44e658b57307f96ac5b8a, iterationId: fdad3ea2-eb31-4ff9-b52e-8ed736417483\\\",\\\"ts\\\":1710091343531,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343531}\\\",\\\"ts\\\":1710091343531,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343531}, latency: 0\\\",\\\"ts\\\":1710091343531,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: fdad3ea2-eb31-4ff9-b52e-8ed736417483, iterationLatency: 10\\\",\\\"ts\\\":1710091343531,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: d79da197-6d21-455e-837b-4683d7c33f8a\\\",\\\"ts\\\":1710091343531,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343531}\\\",\\\"ts\\\":1710091343531,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343531}, latency: 0\\\",\\\"ts\\\":1710091343531,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: d79da197-6d21-455e-837b-4683d7c33f8a\\\",\\\"ts\\\":1710091343531,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 10\\\",\\\"ts\\\":1710091343540,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.gentoo.org/viewtopic-t-987068-view-previous.html?sid\\\\u003db8768715f76715f7991ed345035fcd21, iterationId: d79da197-6d21-455e-837b-4683d7c33f8a\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.gentoo.org/viewtopic-t-987068-view-previous.html?sid\\\\u003db8768715f76715f7991ed345035fcd21, iterationId: d79da197-6d21-455e-837b-4683d7c33f8a\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343541}\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343541}, latency: 0\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.gentoo.org/viewtopic-t-987068-view-previous.html?sid\\\\u003db8768715f76715f7991ed345035fcd21, iterationId: d79da197-6d21-455e-837b-4683d7c33f8a\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.gentoo.org/viewtopic-t-987068-view-previous.html?sid\\\\u003db8768715f76715f7991ed345035fcd21, iterationId: d79da197-6d21-455e-837b-4683d7c33f8a\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.gentoo.org/viewtopic-t-987068-view-previous.html?sid\\\\u003db8768715f76715f7991ed345035fcd21, iterationId: d79da197-6d21-455e-837b-4683d7c33f8a\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 135, recordSize: 1899, indexRecordBytes: 338867\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.gentoo.org/viewtopic-t-987068-view-previous.html?sid\\\\u003db8768715f76715f7991ed345035fcd21, indexRecordsCount: 136, indexRecordsBytes: 340766, numRecordsNotCheckpointed: 136, iterationId: d79da197-6d21-455e-837b-4683d7c33f8a\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.gentoo.org/viewtopic-t-987068-view-previous.html?sid\\\\u003db8768715f76715f7991ed345035fcd21, iterationId: d79da197-6d21-455e-837b-4683d7c33f8a\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343541}\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343541}, latency: 0\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: d79da197-6d21-455e-837b-4683d7c33f8a, iterationLatency: 10\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: f4a62cf8-7885-4171-98e8-64cd54df1e89\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343541}\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343541}, latency: 0\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: f4a62cf8-7885-4171-98e8-64cd54df1e89\\\",\\\"ts\\\":1710091343541,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091343552,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343552,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343552,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.giantitp.com/archive/index.php/t-102058.html?s\\\\u003d92c1205bacc0f9606257a469cc20a8c4, iterationId: f4a62cf8-7885-4171-98e8-64cd54df1e89\\\",\\\"ts\\\":1710091343552,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.giantitp.com/archive/index.php/t-102058.html?s\\\\u003d92c1205bacc0f9606257a469cc20a8c4, iterationId: f4a62cf8-7885-4171-98e8-64cd54df1e89\\\",\\\"ts\\\":1710091343552,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343552,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343552}\\\",\\\"ts\\\":1710091343552,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343552}, latency: 0\\\",\\\"ts\\\":1710091343553,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.giantitp.com/archive/index.php/t-102058.html?s\\\\u003d92c1205bacc0f9606257a469cc20a8c4, iterationId: f4a62cf8-7885-4171-98e8-64cd54df1e89\\\",\\\"ts\\\":1710091343553,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.giantitp.com/archive/index.php/t-102058.html?s\\\\u003d92c1205bacc0f9606257a469cc20a8c4, iterationId: f4a62cf8-7885-4171-98e8-64cd54df1e89\\\",\\\"ts\\\":1710091343553,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.giantitp.com/archive/index.php/t-102058.html?s\\\\u003d92c1205bacc0f9606257a469cc20a8c4, iterationId: f4a62cf8-7885-4171-98e8-64cd54df1e89\\\",\\\"ts\\\":1710091343553,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 136, recordSize: 1157, indexRecordBytes: 340766\\\",\\\"ts\\\":1710091343553,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.giantitp.com/archive/index.php/t-102058.html?s\\\\u003d92c1205bacc0f9606257a469cc20a8c4, indexRecordsCount: 137, indexRecordsBytes: 341923, numRecordsNotCheckpointed: 137, iterationId: f4a62cf8-7885-4171-98e8-64cd54df1e89\\\",\\\"ts\\\":1710091343553,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.giantitp.com/archive/index.php/t-102058.html?s\\\\u003d92c1205bacc0f9606257a469cc20a8c4, iterationId: f4a62cf8-7885-4171-98e8-64cd54df1e89\\\",\\\"ts\\\":1710091343553,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343553}\\\",\\\"ts\\\":1710091343553,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343553}, latency: 0\\\",\\\"ts\\\":1710091343553,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: f4a62cf8-7885-4171-98e8-64cd54df1e89, iterationLatency: 12\\\",\\\"ts\\\":1710091343553,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 924a984f-b2c7-414f-8f55-d97b04ddca82\\\",\\\"ts\\\":1710091343553,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343553}\\\",\\\"ts\\\":1710091343553,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343553}, latency: 0\\\",\\\"ts\\\":1710091343553,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 924a984f-b2c7-414f-8f55-d97b04ddca82\\\",\\\"ts\\\":1710091343553,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091343564,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343564,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343564,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.giantitp.com/archive/index.php/t-583847.html?s\\\\u003d641dfb518a24888f714c9cb7d90c579b, iterationId: 924a984f-b2c7-414f-8f55-d97b04ddca82\\\",\\\"ts\\\":1710091343564,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.giantitp.com/archive/index.php/t-583847.html?s\\\\u003d641dfb518a24888f714c9cb7d90c579b, iterationId: 924a984f-b2c7-414f-8f55-d97b04ddca82\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343565}\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343565}, latency: 0\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.giantitp.com/archive/index.php/t-583847.html?s\\\\u003d641dfb518a24888f714c9cb7d90c579b, iterationId: 924a984f-b2c7-414f-8f55-d97b04ddca82\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.giantitp.com/archive/index.php/t-583847.html?s\\\\u003d641dfb518a24888f714c9cb7d90c579b, iterationId: 924a984f-b2c7-414f-8f55-d97b04ddca82\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.giantitp.com/archive/index.php/t-583847.html?s\\\\u003d641dfb518a24888f714c9cb7d90c579b, iterationId: 924a984f-b2c7-414f-8f55-d97b04ddca82\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 137, recordSize: 1416, indexRecordBytes: 341923\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.giantitp.com/archive/index.php/t-583847.html?s\\\\u003d641dfb518a24888f714c9cb7d90c579b, indexRecordsCount: 138, indexRecordsBytes: 343339, numRecordsNotCheckpointed: 138, iterationId: 924a984f-b2c7-414f-8f55-d97b04ddca82\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.giantitp.com/archive/index.php/t-583847.html?s\\\\u003d641dfb518a24888f714c9cb7d90c579b, iterationId: 924a984f-b2c7-414f-8f55-d97b04ddca82\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343565}\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343565}, latency: 0\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 924a984f-b2c7-414f-8f55-d97b04ddca82, iterationLatency: 12\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 5436a979-5f24-40cb-a44f-23097d73f9d5\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343565}\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343565}, latency: 0\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 5436a979-5f24-40cb-a44f-23097d73f9d5\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343565,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 14\\\",\\\"ts\\\":1710091343579,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343579,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343580,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.giantitp.com/archive/index.php/t-60742.html?s\\\\u003d1f5e86de1452873aaedb37be35946a30, iterationId: 5436a979-5f24-40cb-a44f-23097d73f9d5\\\",\\\"ts\\\":1710091343580,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.giantitp.com/archive/index.php/t-60742.html?s\\\\u003d1f5e86de1452873aaedb37be35946a30, iterationId: 5436a979-5f24-40cb-a44f-23097d73f9d5\\\",\\\"ts\\\":1710091343580,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343580,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343580}\\\",\\\"ts\\\":1710091343580,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343580}, latency: 0\\\",\\\"ts\\\":1710091343580,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.giantitp.com/archive/index.php/t-60742.html?s\\\\u003d1f5e86de1452873aaedb37be35946a30, iterationId: 5436a979-5f24-40cb-a44f-23097d73f9d5\\\",\\\"ts\\\":1710091343580,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.giantitp.com/archive/index.php/t-60742.html?s\\\\u003d1f5e86de1452873aaedb37be35946a30, iterationId: 5436a979-5f24-40cb-a44f-23097d73f9d5\\\",\\\"ts\\\":1710091343580,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.giantitp.com/archive/index.php/t-60742.html?s\\\\u003d1f5e86de1452873aaedb37be35946a30, iterationId: 5436a979-5f24-40cb-a44f-23097d73f9d5\\\",\\\"ts\\\":1710091343582,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 138, recordSize: 9024, indexRecordBytes: 343339\\\",\\\"ts\\\":1710091343582,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.giantitp.com/archive/index.php/t-60742.html?s\\\\u003d1f5e86de1452873aaedb37be35946a30, indexRecordsCount: 139, indexRecordsBytes: 352363, numRecordsNotCheckpointed: 139, iterationId: 5436a979-5f24-40cb-a44f-23097d73f9d5\\\",\\\"ts\\\":1710091343582,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.giantitp.com/archive/index.php/t-60742.html?s\\\\u003d1f5e86de1452873aaedb37be35946a30, iterationId: 5436a979-5f24-40cb-a44f-23097d73f9d5\\\",\\\"ts\\\":1710091343582,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343582}\\\",\\\"ts\\\":1710091343582,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343582}, latency: 0\\\",\\\"ts\\\":1710091343582,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 5436a979-5f24-40cb-a44f-23097d73f9d5, iterationLatency: 17\\\",\\\"ts\\\":1710091343582,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 4892cd67-906b-4fee-ad1a-cbebacbf9aba\\\",\\\"ts\\\":1710091343582,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343582}\\\",\\\"ts\\\":1710091343582,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343582}, latency: 0\\\",\\\"ts\\\":1710091343582,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 4892cd67-906b-4fee-ad1a-cbebacbf9aba\\\",\\\"ts\\\":1710091343582,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 9\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.gt3themes.com/index.php?sid\\\\u003dddcb1261511e4777ab334eb9a91f3ba1, iterationId: 4892cd67-906b-4fee-ad1a-cbebacbf9aba\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.gt3themes.com/index.php?sid\\\\u003dddcb1261511e4777ab334eb9a91f3ba1, iterationId: 4892cd67-906b-4fee-ad1a-cbebacbf9aba\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343590}\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343590}, latency: 0\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.gt3themes.com/index.php?sid\\\\u003dddcb1261511e4777ab334eb9a91f3ba1, iterationId: 4892cd67-906b-4fee-ad1a-cbebacbf9aba\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.gt3themes.com/index.php?sid\\\\u003dddcb1261511e4777ab334eb9a91f3ba1, iterationId: 4892cd67-906b-4fee-ad1a-cbebacbf9aba\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.gt3themes.com/index.php?sid\\\\u003dddcb1261511e4777ab334eb9a91f3ba1, iterationId: 4892cd67-906b-4fee-ad1a-cbebacbf9aba\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 139, recordSize: 872, indexRecordBytes: 352363\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.gt3themes.com/index.php?sid\\\\u003dddcb1261511e4777ab334eb9a91f3ba1, indexRecordsCount: 140, indexRecordsBytes: 353235, numRecordsNotCheckpointed: 140, iterationId: 4892cd67-906b-4fee-ad1a-cbebacbf9aba\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.gt3themes.com/index.php?sid\\\\u003dddcb1261511e4777ab334eb9a91f3ba1, iterationId: 4892cd67-906b-4fee-ad1a-cbebacbf9aba\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343590}\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343590}, latency: 0\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 4892cd67-906b-4fee-ad1a-cbebacbf9aba, iterationLatency: 8\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 92408438-1b7e-4afb-af97-225f686c0afc\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343590}\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343590}, latency: 0\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 92408438-1b7e-4afb-af97-225f686c0afc\\\",\\\"ts\\\":1710091343590,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 8\\\",\\\"ts\\\":1710091343598,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343598,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343598,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.hebi.us/ucp.php?mode\\\\u003dresend_act\\\\u0026sid\\\\u003de1855dbe32831979760c635fad0a9a50, iterationId: 92408438-1b7e-4afb-af97-225f686c0afc\\\",\\\"ts\\\":1710091343598,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.hebi.us/ucp.php?mode\\\\u003dresend_act\\\\u0026sid\\\\u003de1855dbe32831979760c635fad0a9a50, iterationId: 92408438-1b7e-4afb-af97-225f686c0afc\\\",\\\"ts\\\":1710091343598,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343598}\\\",\\\"ts\\\":1710091343598,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343598,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343598}, latency: 0\\\",\\\"ts\\\":1710091343598,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.hebi.us/ucp.php?mode\\\\u003dresend_act\\\\u0026sid\\\\u003de1855dbe32831979760c635fad0a9a50, iterationId: 92408438-1b7e-4afb-af97-225f686c0afc\\\",\\\"ts\\\":1710091343599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.hebi.us/ucp.php?mode\\\\u003dresend_act\\\\u0026sid\\\\u003de1855dbe32831979760c635fad0a9a50, iterationId: 92408438-1b7e-4afb-af97-225f686c0afc\\\",\\\"ts\\\":1710091343599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.hebi.us/ucp.php?mode\\\\u003dresend_act\\\\u0026sid\\\\u003de1855dbe32831979760c635fad0a9a50, iterationId: 92408438-1b7e-4afb-af97-225f686c0afc\\\",\\\"ts\\\":1710091343599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 140, recordSize: 736, indexRecordBytes: 353235\\\",\\\"ts\\\":1710091343599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.hebi.us/ucp.php?mode\\\\u003dresend_act\\\\u0026sid\\\\u003de1855dbe32831979760c635fad0a9a50, indexRecordsCount: 141, indexRecordsBytes: 353971, numRecordsNotCheckpointed: 141, iterationId: 92408438-1b7e-4afb-af97-225f686c0afc\\\",\\\"ts\\\":1710091343599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.hebi.us/ucp.php?mode\\\\u003dresend_act\\\\u0026sid\\\\u003de1855dbe32831979760c635fad0a9a50, iterationId: 92408438-1b7e-4afb-af97-225f686c0afc\\\",\\\"ts\\\":1710091343599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343599}\\\",\\\"ts\\\":1710091343599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343599}, latency: 0\\\",\\\"ts\\\":1710091343599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 92408438-1b7e-4afb-af97-225f686c0afc, iterationLatency: 9\\\",\\\"ts\\\":1710091343599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 8b5cfc78-fb51-4ff1-8cd6-e92a77ffbcd0\\\",\\\"ts\\\":1710091343599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343599}\\\",\\\"ts\\\":1710091343599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343599}, latency: 0\\\",\\\"ts\\\":1710091343599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 8b5cfc78-fb51-4ff1-8cd6-e92a77ffbcd0\\\",\\\"ts\\\":1710091343599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 16\\\",\\\"ts\\\":1710091343614,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343614,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343614,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.htmlhelp.com/index.php?s\\\\u003d5dbdd914b3f44739afe90e1504571073\\\\u0026act\\\\u003didx, iterationId: 8b5cfc78-fb51-4ff1-8cd6-e92a77ffbcd0\\\",\\\"ts\\\":1710091343614,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.htmlhelp.com/index.php?s\\\\u003d5dbdd914b3f44739afe90e1504571073\\\\u0026act\\\\u003didx, iterationId: 8b5cfc78-fb51-4ff1-8cd6-e92a77ffbcd0\\\",\\\"ts\\\":1710091343614,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343615}\\\",\\\"ts\\\":1710091343615,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343614,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343615}, latency: 0\\\",\\\"ts\\\":1710091343615,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.htmlhelp.com/index.php?s\\\\u003d5dbdd914b3f44739afe90e1504571073\\\\u0026act\\\\u003didx, iterationId: 8b5cfc78-fb51-4ff1-8cd6-e92a77ffbcd0\\\",\\\"ts\\\":1710091343615,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.htmlhelp.com/index.php?s\\\\u003d5dbdd914b3f44739afe90e1504571073\\\\u0026act\\\\u003didx, iterationId: 8b5cfc78-fb51-4ff1-8cd6-e92a77ffbcd0\\\",\\\"ts\\\":1710091343615,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.htmlhelp.com/index.php?s\\\\u003d5dbdd914b3f44739afe90e1504571073\\\\u0026act\\\\u003didx, iterationId: 8b5cfc78-fb51-4ff1-8cd6-e92a77ffbcd0\\\",\\\"ts\\\":1710091343615,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 141, recordSize: 2334, indexRecordBytes: 353971\\\",\\\"ts\\\":1710091343615,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.htmlhelp.com/index.php?s\\\\u003d5dbdd914b3f44739afe90e1504571073\\\\u0026act\\\\u003didx, indexRecordsCount: 142, indexRecordsBytes: 356305, numRecordsNotCheckpointed: 142, iterationId: 8b5cfc78-fb51-4ff1-8cd6-e92a77ffbcd0\\\",\\\"ts\\\":1710091343615,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.htmlhelp.com/index.php?s\\\\u003d5dbdd914b3f44739afe90e1504571073\\\\u0026act\\\\u003didx, iterationId: 8b5cfc78-fb51-4ff1-8cd6-e92a77ffbcd0\\\",\\\"ts\\\":1710091343615,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343615}\\\",\\\"ts\\\":1710091343615,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343615}, latency: 0\\\",\\\"ts\\\":1710091343615,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 8b5cfc78-fb51-4ff1-8cd6-e92a77ffbcd0, iterationLatency: 16\\\",\\\"ts\\\":1710091343615,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 65564e9d-3902-445b-9233-ee8e5e1c4cbf\\\",\\\"ts\\\":1710091343615,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343615}\\\",\\\"ts\\\":1710091343615,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343615}, latency: 0\\\",\\\"ts\\\":1710091343615,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 65564e9d-3902-445b-9233-ee8e5e1c4cbf\\\",\\\"ts\\\":1710091343615,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 10\\\",\\\"ts\\\":1710091343625,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343625,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343625,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.htmlhelp.com/index.php?s\\\\u003dba16524222a2b1ec95b61eb08ea47088\\\\u0026act\\\\u003dMembers, iterationId: 65564e9d-3902-445b-9233-ee8e5e1c4cbf\\\",\\\"ts\\\":1710091343625,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.htmlhelp.com/index.php?s\\\\u003dba16524222a2b1ec95b61eb08ea47088\\\\u0026act\\\\u003dMembers, iterationId: 65564e9d-3902-445b-9233-ee8e5e1c4cbf\\\",\\\"ts\\\":1710091343625,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343625}\\\",\\\"ts\\\":1710091343625,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343625,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343625}, latency: 0\\\",\\\"ts\\\":1710091343625,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.htmlhelp.com/index.php?s\\\\u003dba16524222a2b1ec95b61eb08ea47088\\\\u0026act\\\\u003dMembers, iterationId: 65564e9d-3902-445b-9233-ee8e5e1c4cbf\\\",\\\"ts\\\":1710091343625,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.htmlhelp.com/index.php?s\\\\u003dba16524222a2b1ec95b61eb08ea47088\\\\u0026act\\\\u003dMembers, iterationId: 65564e9d-3902-445b-9233-ee8e5e1c4cbf\\\",\\\"ts\\\":1710091343625,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.htmlhelp.com/index.php?s\\\\u003dba16524222a2b1ec95b61eb08ea47088\\\\u0026act\\\\u003dMembers, iterationId: 65564e9d-3902-445b-9233-ee8e5e1c4cbf\\\",\\\"ts\\\":1710091343626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 142, recordSize: 775, indexRecordBytes: 356305\\\",\\\"ts\\\":1710091343626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.htmlhelp.com/index.php?s\\\\u003dba16524222a2b1ec95b61eb08ea47088\\\\u0026act\\\\u003dMembers, indexRecordsCount: 143, indexRecordsBytes: 357080, numRecordsNotCheckpointed: 143, iterationId: 65564e9d-3902-445b-9233-ee8e5e1c4cbf\\\",\\\"ts\\\":1710091343626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.htmlhelp.com/index.php?s\\\\u003dba16524222a2b1ec95b61eb08ea47088\\\\u0026act\\\\u003dMembers, iterationId: 65564e9d-3902-445b-9233-ee8e5e1c4cbf\\\",\\\"ts\\\":1710091343626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343626}\\\",\\\"ts\\\":1710091343626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343626}, latency: 0\\\",\\\"ts\\\":1710091343626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 65564e9d-3902-445b-9233-ee8e5e1c4cbf, iterationLatency: 11\\\",\\\"ts\\\":1710091343626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 76d08994-2bd4-4900-8817-d661a396270d\\\",\\\"ts\\\":1710091343626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343626}\\\",\\\"ts\\\":1710091343626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343626}, latency: 0\\\",\\\"ts\\\":1710091343626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 76d08994-2bd4-4900-8817-d661a396270d\\\",\\\"ts\\\":1710091343626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 10\\\",\\\"ts\\\":1710091343636,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343636,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343636,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.ifamilyformac.com/viewforum.php?f\\\\u003d16\\\\u0026sid\\\\u003d13fd4c201ec8fa6ec7963992fa627879, iterationId: 76d08994-2bd4-4900-8817-d661a396270d\\\",\\\"ts\\\":1710091343636,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.ifamilyformac.com/viewforum.php?f\\\\u003d16\\\\u0026sid\\\\u003d13fd4c201ec8fa6ec7963992fa627879, iterationId: 76d08994-2bd4-4900-8817-d661a396270d\\\",\\\"ts\\\":1710091343636,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343636,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343636}\\\",\\\"ts\\\":1710091343636,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343636}, latency: 0\\\",\\\"ts\\\":1710091343636,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.ifamilyformac.com/viewforum.php?f\\\\u003d16\\\\u0026sid\\\\u003d13fd4c201ec8fa6ec7963992fa627879, iterationId: 76d08994-2bd4-4900-8817-d661a396270d\\\",\\\"ts\\\":1710091343636,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.ifamilyformac.com/viewforum.php?f\\\\u003d16\\\\u0026sid\\\\u003d13fd4c201ec8fa6ec7963992fa627879, iterationId: 76d08994-2bd4-4900-8817-d661a396270d\\\",\\\"ts\\\":1710091343636,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.ifamilyformac.com/viewforum.php?f\\\\u003d16\\\\u0026sid\\\\u003d13fd4c201ec8fa6ec7963992fa627879, iterationId: 76d08994-2bd4-4900-8817-d661a396270d\\\",\\\"ts\\\":1710091343637,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 143, recordSize: 1272, indexRecordBytes: 357080\\\",\\\"ts\\\":1710091343637,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.ifamilyformac.com/viewforum.php?f\\\\u003d16\\\\u0026sid\\\\u003d13fd4c201ec8fa6ec7963992fa627879, indexRecordsCount: 144, indexRecordsBytes: 358352, numRecordsNotCheckpointed: 144, iterationId: 76d08994-2bd4-4900-8817-d661a396270d\\\",\\\"ts\\\":1710091343637,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.ifamilyformac.com/viewforum.php?f\\\\u003d16\\\\u0026sid\\\\u003d13fd4c201ec8fa6ec7963992fa627879, iterationId: 76d08994-2bd4-4900-8817-d661a396270d\\\",\\\"ts\\\":1710091343637,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343637}\\\",\\\"ts\\\":1710091343637,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343637}, latency: 0\\\",\\\"ts\\\":1710091343637,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 76d08994-2bd4-4900-8817-d661a396270d, iterationLatency: 11\\\",\\\"ts\\\":1710091343637,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 5b20d885-6887-4f0b-bffd-5c40f56a7448\\\",\\\"ts\\\":1710091343637,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343637}\\\",\\\"ts\\\":1710091343637,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343637}, latency: 0\\\",\\\"ts\\\":1710091343637,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 5b20d885-6887-4f0b-bffd-5c40f56a7448\\\",\\\"ts\\\":1710091343637,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091343647,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343647,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343647,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.liveatc.net/feed-outagestatus-reports/cyhu-feed-outage-15818/?PHPSESSID\\\\u003d4k03m54go0bgmp59b7laibv850, iterationId: 5b20d885-6887-4f0b-bffd-5c40f56a7448\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.liveatc.net/feed-outagestatus-reports/cyhu-feed-outage-15818/?PHPSESSID\\\\u003d4k03m54go0bgmp59b7laibv850, iterationId: 5b20d885-6887-4f0b-bffd-5c40f56a7448\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343648}\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343648}, latency: 0\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.liveatc.net/feed-outagestatus-reports/cyhu-feed-outage-15818/?PHPSESSID\\\\u003d4k03m54go0bgmp59b7laibv850, iterationId: 5b20d885-6887-4f0b-bffd-5c40f56a7448\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.liveatc.net/feed-outagestatus-reports/cyhu-feed-outage-15818/?PHPSESSID\\\\u003d4k03m54go0bgmp59b7laibv850, iterationId: 5b20d885-6887-4f0b-bffd-5c40f56a7448\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.liveatc.net/feed-outagestatus-reports/cyhu-feed-outage-15818/?PHPSESSID\\\\u003d4k03m54go0bgmp59b7laibv850, iterationId: 5b20d885-6887-4f0b-bffd-5c40f56a7448\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 144, recordSize: 978, indexRecordBytes: 358352\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.liveatc.net/feed-outagestatus-reports/cyhu-feed-outage-15818/?PHPSESSID\\\\u003d4k03m54go0bgmp59b7laibv850, indexRecordsCount: 145, indexRecordsBytes: 359330, numRecordsNotCheckpointed: 145, iterationId: 5b20d885-6887-4f0b-bffd-5c40f56a7448\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.liveatc.net/feed-outagestatus-reports/cyhu-feed-outage-15818/?PHPSESSID\\\\u003d4k03m54go0bgmp59b7laibv850, iterationId: 5b20d885-6887-4f0b-bffd-5c40f56a7448\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343648}\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343648}, latency: 0\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 5b20d885-6887-4f0b-bffd-5c40f56a7448, iterationLatency: 11\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: c32f55a0-c206-4cac-b6be-59c47c4c164f\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343648}\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343648}, latency: 0\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: c32f55a0-c206-4cac-b6be-59c47c4c164f\\\",\\\"ts\\\":1710091343648,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091343659,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343660,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343660,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.luxcorerender.org/index.php?sid\\\\u003d20ea51483ebaa1968ee9ec4c11f851e3, iterationId: c32f55a0-c206-4cac-b6be-59c47c4c164f\\\",\\\"ts\\\":1710091343660,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.luxcorerender.org/index.php?sid\\\\u003d20ea51483ebaa1968ee9ec4c11f851e3, iterationId: c32f55a0-c206-4cac-b6be-59c47c4c164f\\\",\\\"ts\\\":1710091343660,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343660}\\\",\\\"ts\\\":1710091343660,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343660,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343660}, latency: 0\\\",\\\"ts\\\":1710091343660,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.luxcorerender.org/index.php?sid\\\\u003d20ea51483ebaa1968ee9ec4c11f851e3, iterationId: c32f55a0-c206-4cac-b6be-59c47c4c164f\\\",\\\"ts\\\":1710091343660,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.luxcorerender.org/index.php?sid\\\\u003d20ea51483ebaa1968ee9ec4c11f851e3, iterationId: c32f55a0-c206-4cac-b6be-59c47c4c164f\\\",\\\"ts\\\":1710091343660,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.luxcorerender.org/index.php?sid\\\\u003d20ea51483ebaa1968ee9ec4c11f851e3, iterationId: c32f55a0-c206-4cac-b6be-59c47c4c164f\\\",\\\"ts\\\":1710091343660,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 145, recordSize: 1467, indexRecordBytes: 359330\\\",\\\"ts\\\":1710091343660,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.luxcorerender.org/index.php?sid\\\\u003d20ea51483ebaa1968ee9ec4c11f851e3, indexRecordsCount: 146, indexRecordsBytes: 360797, numRecordsNotCheckpointed: 146, iterationId: c32f55a0-c206-4cac-b6be-59c47c4c164f\\\",\\\"ts\\\":1710091343661,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.luxcorerender.org/index.php?sid\\\\u003d20ea51483ebaa1968ee9ec4c11f851e3, iterationId: c32f55a0-c206-4cac-b6be-59c47c4c164f\\\",\\\"ts\\\":1710091343661,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343661}\\\",\\\"ts\\\":1710091343661,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343661}, latency: 0\\\",\\\"ts\\\":1710091343661,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: c32f55a0-c206-4cac-b6be-59c47c4c164f, iterationLatency: 13\\\",\\\"ts\\\":1710091343661,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 1465017a-b5d1-47c7-bb2e-03e3958ea8a1\\\",\\\"ts\\\":1710091343661,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343661}\\\",\\\"ts\\\":1710091343661,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343661}, latency: 0\\\",\\\"ts\\\":1710091343661,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 1465017a-b5d1-47c7-bb2e-03e3958ea8a1\\\",\\\"ts\\\":1710091343661,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091343672,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.macg.co/threads/question-sur-lipad-et-garage-band-studio-hd-i-movie.857932/, iterationId: 1465017a-b5d1-47c7-bb2e-03e3958ea8a1\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.macg.co/threads/question-sur-lipad-et-garage-band-studio-hd-i-movie.857932/, iterationId: 1465017a-b5d1-47c7-bb2e-03e3958ea8a1\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343673}\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343673}, latency: 0\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.macg.co/threads/question-sur-lipad-et-garage-band-studio-hd-i-movie.857932/, iterationId: 1465017a-b5d1-47c7-bb2e-03e3958ea8a1\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.macg.co/threads/question-sur-lipad-et-garage-band-studio-hd-i-movie.857932/, iterationId: 1465017a-b5d1-47c7-bb2e-03e3958ea8a1\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.macg.co/threads/question-sur-lipad-et-garage-band-studio-hd-i-movie.857932/, iterationId: 1465017a-b5d1-47c7-bb2e-03e3958ea8a1\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 146, recordSize: 2298, indexRecordBytes: 360797\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.macg.co/threads/question-sur-lipad-et-garage-band-studio-hd-i-movie.857932/, indexRecordsCount: 147, indexRecordsBytes: 363095, numRecordsNotCheckpointed: 147, iterationId: 1465017a-b5d1-47c7-bb2e-03e3958ea8a1\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.macg.co/threads/question-sur-lipad-et-garage-band-studio-hd-i-movie.857932/, iterationId: 1465017a-b5d1-47c7-bb2e-03e3958ea8a1\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343673}\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343673}, latency: 0\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 1465017a-b5d1-47c7-bb2e-03e3958ea8a1, iterationLatency: 12\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 0db7ebe4-744d-4dc4-9349-a7ef008cb8fc\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343673}\\\",\\\"ts\\\":1710091343673,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343673}, latency: 0\\\",\\\"ts\\\":1710091343674,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 0db7ebe4-744d-4dc4-9349-a7ef008cb8fc\\\",\\\"ts\\\":1710091343674,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 14\\\",\\\"ts\\\":1710091343687,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343687,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343687,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343688,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.ogre3d.org/ucp.php?mode\\\\u003ddelete_cookies\\\\u0026sid\\\\u003df1551c8076be20cae588ddcb752cb6f2, iterationId: 0db7ebe4-744d-4dc4-9349-a7ef008cb8fc\\\",\\\"ts\\\":1710091343689,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.ogre3d.org/ucp.php?mode\\\\u003ddelete_cookies\\\\u0026sid\\\\u003df1551c8076be20cae588ddcb752cb6f2, iterationId: 0db7ebe4-744d-4dc4-9349-a7ef008cb8fc\\\",\\\"ts\\\":1710091343689,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343689}\\\",\\\"ts\\\":1710091343689,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343689}, latency: 0\\\",\\\"ts\\\":1710091343689,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.ogre3d.org/ucp.php?mode\\\\u003ddelete_cookies\\\\u0026sid\\\\u003df1551c8076be20cae588ddcb752cb6f2, iterationId: 0db7ebe4-744d-4dc4-9349-a7ef008cb8fc\\\",\\\"ts\\\":1710091343689,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.ogre3d.org/ucp.php?mode\\\\u003ddelete_cookies\\\\u0026sid\\\\u003df1551c8076be20cae588ddcb752cb6f2, iterationId: 0db7ebe4-744d-4dc4-9349-a7ef008cb8fc\\\",\\\"ts\\\":1710091343689,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.ogre3d.org/ucp.php?mode\\\\u003ddelete_cookies\\\\u0026sid\\\\u003df1551c8076be20cae588ddcb752cb6f2, iterationId: 0db7ebe4-744d-4dc4-9349-a7ef008cb8fc\\\",\\\"ts\\\":1710091343690,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 147, recordSize: 503, indexRecordBytes: 363095\\\",\\\"ts\\\":1710091343690,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.ogre3d.org/ucp.php?mode\\\\u003ddelete_cookies\\\\u0026sid\\\\u003df1551c8076be20cae588ddcb752cb6f2, indexRecordsCount: 148, indexRecordsBytes: 363598, numRecordsNotCheckpointed: 148, iterationId: 0db7ebe4-744d-4dc4-9349-a7ef008cb8fc\\\",\\\"ts\\\":1710091343690,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.ogre3d.org/ucp.php?mode\\\\u003ddelete_cookies\\\\u0026sid\\\\u003df1551c8076be20cae588ddcb752cb6f2, iterationId: 0db7ebe4-744d-4dc4-9349-a7ef008cb8fc\\\",\\\"ts\\\":1710091343690,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343690}\\\",\\\"ts\\\":1710091343690,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343690}, latency: 0\\\",\\\"ts\\\":1710091343690,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 0db7ebe4-744d-4dc4-9349-a7ef008cb8fc, iterationLatency: 17\\\",\\\"ts\\\":1710091343690,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 3ca26114-7e87-430d-9cd5-add097fd88f2\\\",\\\"ts\\\":1710091343690,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343690}\\\",\\\"ts\\\":1710091343690,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343690}, latency: 0\\\",\\\"ts\\\":1710091343690,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 3ca26114-7e87-430d-9cd5-add097fd88f2\\\",\\\"ts\\\":1710091343690,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 16\\\",\\\"ts\\\":1710091343704,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343704,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343704,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.ppsspp.org/showthread.php?tid\\\\u003d3590\\\\u0026pid\\\\u003d108820, iterationId: 3ca26114-7e87-430d-9cd5-add097fd88f2\\\",\\\"ts\\\":1710091343704,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.ppsspp.org/showthread.php?tid\\\\u003d3590\\\\u0026pid\\\\u003d108820, iterationId: 3ca26114-7e87-430d-9cd5-add097fd88f2\\\",\\\"ts\\\":1710091343704,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343704}\\\",\\\"ts\\\":1710091343704,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343704}, latency: 0\\\",\\\"ts\\\":1710091343704,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.ppsspp.org/showthread.php?tid\\\\u003d3590\\\\u0026pid\\\\u003d108820, iterationId: 3ca26114-7e87-430d-9cd5-add097fd88f2\\\",\\\"ts\\\":1710091343704,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.ppsspp.org/showthread.php?tid\\\\u003d3590\\\\u0026pid\\\\u003d108820, iterationId: 3ca26114-7e87-430d-9cd5-add097fd88f2\\\",\\\"ts\\\":1710091343704,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343704,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.ppsspp.org/showthread.php?tid\\\\u003d3590\\\\u0026pid\\\\u003d108820, iterationId: 3ca26114-7e87-430d-9cd5-add097fd88f2\\\",\\\"ts\\\":1710091343706,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 148, recordSize: 8196, indexRecordBytes: 363598\\\",\\\"ts\\\":1710091343706,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.ppsspp.org/showthread.php?tid\\\\u003d3590\\\\u0026pid\\\\u003d108820, indexRecordsCount: 149, indexRecordsBytes: 371794, numRecordsNotCheckpointed: 149, iterationId: 3ca26114-7e87-430d-9cd5-add097fd88f2\\\",\\\"ts\\\":1710091343706,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.ppsspp.org/showthread.php?tid\\\\u003d3590\\\\u0026pid\\\\u003d108820, iterationId: 3ca26114-7e87-430d-9cd5-add097fd88f2\\\",\\\"ts\\\":1710091343706,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343706}\\\",\\\"ts\\\":1710091343706,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343706}, latency: 0\\\",\\\"ts\\\":1710091343706,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 3ca26114-7e87-430d-9cd5-add097fd88f2, iterationLatency: 16\\\",\\\"ts\\\":1710091343706,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 88473703-ecab-4b7a-b6d8-8134facfdfe3\\\",\\\"ts\\\":1710091343706,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343706}\\\",\\\"ts\\\":1710091343706,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343706}, latency: 0\\\",\\\"ts\\\":1710091343706,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 88473703-ecab-4b7a-b6d8-8134facfdfe3\\\",\\\"ts\\\":1710091343706,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091343715,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343715,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343715,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.redflagdeals.com/tags/1700/, iterationId: 88473703-ecab-4b7a-b6d8-8134facfdfe3\\\",\\\"ts\\\":1710091343715,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.redflagdeals.com/tags/1700/, iterationId: 88473703-ecab-4b7a-b6d8-8134facfdfe3\\\",\\\"ts\\\":1710091343715,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343715}\\\",\\\"ts\\\":1710091343715,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343715,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343715}, latency: 0\\\",\\\"ts\\\":1710091343715,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.redflagdeals.com/tags/1700/, iterationId: 88473703-ecab-4b7a-b6d8-8134facfdfe3\\\",\\\"ts\\\":1710091343715,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.redflagdeals.com/tags/1700/, iterationId: 88473703-ecab-4b7a-b6d8-8134facfdfe3\\\",\\\"ts\\\":1710091343715,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.redflagdeals.com/tags/1700/, iterationId: 88473703-ecab-4b7a-b6d8-8134facfdfe3\\\",\\\"ts\\\":1710091343716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 149, recordSize: 5614, indexRecordBytes: 371794\\\",\\\"ts\\\":1710091343716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.redflagdeals.com/tags/1700/, indexRecordsCount: 150, indexRecordsBytes: 377408, numRecordsNotCheckpointed: 150, iterationId: 88473703-ecab-4b7a-b6d8-8134facfdfe3\\\",\\\"ts\\\":1710091343716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.redflagdeals.com/tags/1700/, iterationId: 88473703-ecab-4b7a-b6d8-8134facfdfe3\\\",\\\"ts\\\":1710091343716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343716}\\\",\\\"ts\\\":1710091343716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343716}, latency: 0\\\",\\\"ts\\\":1710091343716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 88473703-ecab-4b7a-b6d8-8134facfdfe3, iterationLatency: 10\\\",\\\"ts\\\":1710091343716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: ff0ea5f7-037c-41d9-8d83-5fa5bde65b3d\\\",\\\"ts\\\":1710091343716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343716}\\\",\\\"ts\\\":1710091343716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343716}, latency: 0\\\",\\\"ts\\\":1710091343716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: ff0ea5f7-037c-41d9-8d83-5fa5bde65b3d\\\",\\\"ts\\\":1710091343716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091343727,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343727,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343727,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.rockylinux.org/t/how-do-you-deal-with-older-git-packages-in-rocky-repos/9307, iterationId: ff0ea5f7-037c-41d9-8d83-5fa5bde65b3d\\\",\\\"ts\\\":1710091343727,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.rockylinux.org/t/how-do-you-deal-with-older-git-packages-in-rocky-repos/9307, iterationId: ff0ea5f7-037c-41d9-8d83-5fa5bde65b3d\\\",\\\"ts\\\":1710091343727,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343727}\\\",\\\"ts\\\":1710091343727,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343727}, latency: 0\\\",\\\"ts\\\":1710091343727,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.rockylinux.org/t/how-do-you-deal-with-older-git-packages-in-rocky-repos/9307, iterationId: ff0ea5f7-037c-41d9-8d83-5fa5bde65b3d\\\",\\\"ts\\\":1710091343727,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.rockylinux.org/t/how-do-you-deal-with-older-git-packages-in-rocky-repos/9307, iterationId: ff0ea5f7-037c-41d9-8d83-5fa5bde65b3d\\\",\\\"ts\\\":1710091343727,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343727,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.rockylinux.org/t/how-do-you-deal-with-older-git-packages-in-rocky-repos/9307, iterationId: ff0ea5f7-037c-41d9-8d83-5fa5bde65b3d\\\",\\\"ts\\\":1710091343728,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 150, recordSize: 2181, indexRecordBytes: 377408\\\",\\\"ts\\\":1710091343728,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.rockylinux.org/t/how-do-you-deal-with-older-git-packages-in-rocky-repos/9307, indexRecordsCount: 151, indexRecordsBytes: 379589, numRecordsNotCheckpointed: 151, iterationId: ff0ea5f7-037c-41d9-8d83-5fa5bde65b3d\\\",\\\"ts\\\":1710091343728,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.rockylinux.org/t/how-do-you-deal-with-older-git-packages-in-rocky-repos/9307, iterationId: ff0ea5f7-037c-41d9-8d83-5fa5bde65b3d\\\",\\\"ts\\\":1710091343728,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343728}\\\",\\\"ts\\\":1710091343728,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343728}, latency: 0\\\",\\\"ts\\\":1710091343728,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: ff0ea5f7-037c-41d9-8d83-5fa5bde65b3d, iterationLatency: 12\\\",\\\"ts\\\":1710091343728,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: b5d96684-cd86-47a6-8bbb-32beb9769b2b\\\",\\\"ts\\\":1710091343728,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343728}\\\",\\\"ts\\\":1710091343728,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343728}, latency: 0\\\",\\\"ts\\\":1710091343728,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: b5d96684-cd86-47a6-8bbb-32beb9769b2b\\\",\\\"ts\\\":1710091343728,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091343739,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343741,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343741,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.sluggy.com/search.php?search_id\\\\u003dactive_topics\\\\u0026sid\\\\u003d0c132bf04131f993ebbaa5a9e1c8f196, iterationId: b5d96684-cd86-47a6-8bbb-32beb9769b2b\\\",\\\"ts\\\":1710091343741,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.sluggy.com/search.php?search_id\\\\u003dactive_topics\\\\u0026sid\\\\u003d0c132bf04131f993ebbaa5a9e1c8f196, iterationId: b5d96684-cd86-47a6-8bbb-32beb9769b2b\\\",\\\"ts\\\":1710091343741,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343741}\\\",\\\"ts\\\":1710091343741,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343741}, latency: 0\\\",\\\"ts\\\":1710091343741,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.sluggy.com/search.php?search_id\\\\u003dactive_topics\\\\u0026sid\\\\u003d0c132bf04131f993ebbaa5a9e1c8f196, iterationId: b5d96684-cd86-47a6-8bbb-32beb9769b2b\\\",\\\"ts\\\":1710091343741,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.sluggy.com/search.php?search_id\\\\u003dactive_topics\\\\u0026sid\\\\u003d0c132bf04131f993ebbaa5a9e1c8f196, iterationId: b5d96684-cd86-47a6-8bbb-32beb9769b2b\\\",\\\"ts\\\":1710091343741,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.sluggy.com/search.php?search_id\\\\u003dactive_topics\\\\u0026sid\\\\u003d0c132bf04131f993ebbaa5a9e1c8f196, iterationId: b5d96684-cd86-47a6-8bbb-32beb9769b2b\\\",\\\"ts\\\":1710091343742,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343741,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 151, recordSize: 812, indexRecordBytes: 379589\\\",\\\"ts\\\":1710091343742,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.sluggy.com/search.php?search_id\\\\u003dactive_topics\\\\u0026sid\\\\u003d0c132bf04131f993ebbaa5a9e1c8f196, indexRecordsCount: 152, indexRecordsBytes: 380401, numRecordsNotCheckpointed: 152, iterationId: b5d96684-cd86-47a6-8bbb-32beb9769b2b\\\",\\\"ts\\\":1710091343742,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.sluggy.com/search.php?search_id\\\\u003dactive_topics\\\\u0026sid\\\\u003d0c132bf04131f993ebbaa5a9e1c8f196, iterationId: b5d96684-cd86-47a6-8bbb-32beb9769b2b\\\",\\\"ts\\\":1710091343742,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343742}\\\",\\\"ts\\\":1710091343742,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343742}, latency: 0\\\",\\\"ts\\\":1710091343742,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: b5d96684-cd86-47a6-8bbb-32beb9769b2b, iterationLatency: 14\\\",\\\"ts\\\":1710091343742,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: c996d6c6-cb2f-4ed2-8eb0-e6e49d89aad5\\\",\\\"ts\\\":1710091343742,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343742}\\\",\\\"ts\\\":1710091343742,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343742}, latency: 0\\\",\\\"ts\\\":1710091343742,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: c996d6c6-cb2f-4ed2-8eb0-e6e49d89aad5\\\",\\\"ts\\\":1710091343742,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 10\\\",\\\"ts\\\":1710091343752,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343752,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343752,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.sluggy.com/search.php?sid\\\\u003d648ea431573c820db7f5d9d7227c0624, iterationId: c996d6c6-cb2f-4ed2-8eb0-e6e49d89aad5\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.sluggy.com/search.php?sid\\\\u003d648ea431573c820db7f5d9d7227c0624, iterationId: c996d6c6-cb2f-4ed2-8eb0-e6e49d89aad5\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343753}\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343753}, latency: 0\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.sluggy.com/search.php?sid\\\\u003d648ea431573c820db7f5d9d7227c0624, iterationId: c996d6c6-cb2f-4ed2-8eb0-e6e49d89aad5\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.sluggy.com/search.php?sid\\\\u003d648ea431573c820db7f5d9d7227c0624, iterationId: c996d6c6-cb2f-4ed2-8eb0-e6e49d89aad5\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.sluggy.com/search.php?sid\\\\u003d648ea431573c820db7f5d9d7227c0624, iterationId: c996d6c6-cb2f-4ed2-8eb0-e6e49d89aad5\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 152, recordSize: 1145, indexRecordBytes: 380401\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.sluggy.com/search.php?sid\\\\u003d648ea431573c820db7f5d9d7227c0624, indexRecordsCount: 153, indexRecordsBytes: 381546, numRecordsNotCheckpointed: 153, iterationId: c996d6c6-cb2f-4ed2-8eb0-e6e49d89aad5\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.sluggy.com/search.php?sid\\\\u003d648ea431573c820db7f5d9d7227c0624, iterationId: c996d6c6-cb2f-4ed2-8eb0-e6e49d89aad5\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343753}\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343753}, latency: 0\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: c996d6c6-cb2f-4ed2-8eb0-e6e49d89aad5, iterationLatency: 11\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 2b7c8783-473b-4d4d-94c3-f625b51f8379\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343753}\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343753}, latency: 0\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 2b7c8783-473b-4d4d-94c3-f625b51f8379\\\",\\\"ts\\\":1710091343753,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 10\\\",\\\"ts\\\":1710091343763,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343763,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343763,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.somethingawful.com/showthread.php?action\\\\u003dsetseen\\\\u0026threadid\\\\u003d3598931\\\\u0026index\\\\u003d4223, iterationId: 2b7c8783-473b-4d4d-94c3-f625b51f8379\\\",\\\"ts\\\":1710091343763,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.somethingawful.com/showthread.php?action\\\\u003dsetseen\\\\u0026threadid\\\\u003d3598931\\\\u0026index\\\\u003d4223, iterationId: 2b7c8783-473b-4d4d-94c3-f625b51f8379\\\",\\\"ts\\\":1710091343763,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343763,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343763}\\\",\\\"ts\\\":1710091343763,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343763}, latency: 0\\\",\\\"ts\\\":1710091343763,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.somethingawful.com/showthread.php?action\\\\u003dsetseen\\\\u0026threadid\\\\u003d3598931\\\\u0026index\\\\u003d4223, iterationId: 2b7c8783-473b-4d4d-94c3-f625b51f8379\\\",\\\"ts\\\":1710091343763,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.somethingawful.com/showthread.php?action\\\\u003dsetseen\\\\u0026threadid\\\\u003d3598931\\\\u0026index\\\\u003d4223, iterationId: 2b7c8783-473b-4d4d-94c3-f625b51f8379\\\",\\\"ts\\\":1710091343763,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.somethingawful.com/showthread.php?action\\\\u003dsetseen\\\\u0026threadid\\\\u003d3598931\\\\u0026index\\\\u003d4223, iterationId: 2b7c8783-473b-4d4d-94c3-f625b51f8379\\\",\\\"ts\\\":1710091343764,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 153, recordSize: 1998, indexRecordBytes: 381546\\\",\\\"ts\\\":1710091343764,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.somethingawful.com/showthread.php?action\\\\u003dsetseen\\\\u0026threadid\\\\u003d3598931\\\\u0026index\\\\u003d4223, indexRecordsCount: 154, indexRecordsBytes: 383544, numRecordsNotCheckpointed: 154, iterationId: 2b7c8783-473b-4d4d-94c3-f625b51f8379\\\",\\\"ts\\\":1710091343764,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.somethingawful.com/showthread.php?action\\\\u003dsetseen\\\\u0026threadid\\\\u003d3598931\\\\u0026index\\\\u003d4223, iterationId: 2b7c8783-473b-4d4d-94c3-f625b51f8379\\\",\\\"ts\\\":1710091343764,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343764}\\\",\\\"ts\\\":1710091343764,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343764}, latency: 0\\\",\\\"ts\\\":1710091343764,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 2b7c8783-473b-4d4d-94c3-f625b51f8379, iterationLatency: 11\\\",\\\"ts\\\":1710091343764,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 8ec8ec3d-4071-477c-87bc-2a0560adfe9f\\\",\\\"ts\\\":1710091343764,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343764}\\\",\\\"ts\\\":1710091343764,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343764}, latency: 0\\\",\\\"ts\\\":1710091343764,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 8ec8ec3d-4071-477c-87bc-2a0560adfe9f\\\",\\\"ts\\\":1710091343764,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091343775,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343775,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343775,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.stellaremperor.com/search.php?search_id\\\\u003dunanswered\\\\u0026sid\\\\u003daa5eb89e182b2cc07de9684e5e1e2aad, iterationId: 8ec8ec3d-4071-477c-87bc-2a0560adfe9f\\\",\\\"ts\\\":1710091343775,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.stellaremperor.com/search.php?search_id\\\\u003dunanswered\\\\u0026sid\\\\u003daa5eb89e182b2cc07de9684e5e1e2aad, iterationId: 8ec8ec3d-4071-477c-87bc-2a0560adfe9f\\\",\\\"ts\\\":1710091343775,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343775,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343775}\\\",\\\"ts\\\":1710091343775,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343775}, latency: 0\\\",\\\"ts\\\":1710091343775,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.stellaremperor.com/search.php?search_id\\\\u003dunanswered\\\\u0026sid\\\\u003daa5eb89e182b2cc07de9684e5e1e2aad, iterationId: 8ec8ec3d-4071-477c-87bc-2a0560adfe9f\\\",\\\"ts\\\":1710091343775,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.stellaremperor.com/search.php?search_id\\\\u003dunanswered\\\\u0026sid\\\\u003daa5eb89e182b2cc07de9684e5e1e2aad, iterationId: 8ec8ec3d-4071-477c-87bc-2a0560adfe9f\\\",\\\"ts\\\":1710091343775,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.stellaremperor.com/search.php?search_id\\\\u003dunanswered\\\\u0026sid\\\\u003daa5eb89e182b2cc07de9684e5e1e2aad, iterationId: 8ec8ec3d-4071-477c-87bc-2a0560adfe9f\\\",\\\"ts\\\":1710091343775,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 154, recordSize: 1842, indexRecordBytes: 383544\\\",\\\"ts\\\":1710091343776,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.stellaremperor.com/search.php?search_id\\\\u003dunanswered\\\\u0026sid\\\\u003daa5eb89e182b2cc07de9684e5e1e2aad, indexRecordsCount: 155, indexRecordsBytes: 385386, numRecordsNotCheckpointed: 155, iterationId: 8ec8ec3d-4071-477c-87bc-2a0560adfe9f\\\",\\\"ts\\\":1710091343776,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.stellaremperor.com/search.php?search_id\\\\u003dunanswered\\\\u0026sid\\\\u003daa5eb89e182b2cc07de9684e5e1e2aad, iterationId: 8ec8ec3d-4071-477c-87bc-2a0560adfe9f\\\",\\\"ts\\\":1710091343776,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343776}\\\",\\\"ts\\\":1710091343776,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343776}, latency: 0\\\",\\\"ts\\\":1710091343776,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 8ec8ec3d-4071-477c-87bc-2a0560adfe9f, iterationLatency: 12\\\",\\\"ts\\\":1710091343776,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 4026488f-a08c-4185-9a5e-d8960b766482\\\",\\\"ts\\\":1710091343776,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343776}\\\",\\\"ts\\\":1710091343776,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343776}, latency: 0\\\",\\\"ts\\\":1710091343776,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 4026488f-a08c-4185-9a5e-d8960b766482\\\",\\\"ts\\\":1710091343776,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 9\\\",\\\"ts\\\":1710091343784,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.tdiclub.com/index.php?media/00o0o_kcseaubjpr1_600x450.117468/, iterationId: 4026488f-a08c-4185-9a5e-d8960b766482\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.tdiclub.com/index.php?media/00o0o_kcseaubjpr1_600x450.117468/, iterationId: 4026488f-a08c-4185-9a5e-d8960b766482\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343785}\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343785}, latency: 0\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.tdiclub.com/index.php?media/00o0o_kcseaubjpr1_600x450.117468/, iterationId: 4026488f-a08c-4185-9a5e-d8960b766482\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.tdiclub.com/index.php?media/00o0o_kcseaubjpr1_600x450.117468/, iterationId: 4026488f-a08c-4185-9a5e-d8960b766482\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.tdiclub.com/index.php?media/00o0o_kcseaubjpr1_600x450.117468/, iterationId: 4026488f-a08c-4185-9a5e-d8960b766482\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 155, recordSize: 1000, indexRecordBytes: 385386\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.tdiclub.com/index.php?media/00o0o_kcseaubjpr1_600x450.117468/, indexRecordsCount: 156, indexRecordsBytes: 386386, numRecordsNotCheckpointed: 156, iterationId: 4026488f-a08c-4185-9a5e-d8960b766482\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.tdiclub.com/index.php?media/00o0o_kcseaubjpr1_600x450.117468/, iterationId: 4026488f-a08c-4185-9a5e-d8960b766482\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343785}\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343785}, latency: 0\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 4026488f-a08c-4185-9a5e-d8960b766482, iterationLatency: 9\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: f4e12c5a-3837-4a11-82a9-35dac8de3911\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343785}\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343785}, latency: 0\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: f4e12c5a-3837-4a11-82a9-35dac8de3911\\\",\\\"ts\\\":1710091343785,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091343796,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.thesims.com/en_us/profile/Battyivy21, iterationId: f4e12c5a-3837-4a11-82a9-35dac8de3911\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.thesims.com/en_us/profile/Battyivy21, iterationId: f4e12c5a-3837-4a11-82a9-35dac8de3911\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343797}\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343797}, latency: 0\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.thesims.com/en_us/profile/Battyivy21, iterationId: f4e12c5a-3837-4a11-82a9-35dac8de3911\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.thesims.com/en_us/profile/Battyivy21, iterationId: f4e12c5a-3837-4a11-82a9-35dac8de3911\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.thesims.com/en_us/profile/Battyivy21, iterationId: f4e12c5a-3837-4a11-82a9-35dac8de3911\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 156, recordSize: 1011, indexRecordBytes: 386386\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.thesims.com/en_us/profile/Battyivy21, indexRecordsCount: 157, indexRecordsBytes: 387397, numRecordsNotCheckpointed: 157, iterationId: f4e12c5a-3837-4a11-82a9-35dac8de3911\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.thesims.com/en_us/profile/Battyivy21, iterationId: f4e12c5a-3837-4a11-82a9-35dac8de3911\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343797}\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343797}, latency: 0\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: f4e12c5a-3837-4a11-82a9-35dac8de3911, iterationLatency: 12\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 9d4a9a8c-f90e-4def-a9cb-1844ca37b07f\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343797}\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343797}, latency: 0\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 9d4a9a8c-f90e-4def-a9cb-1844ca37b07f\\\",\\\"ts\\\":1710091343797,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091343808,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343808,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.tomsguide.com/threads/8-questions-for-apples-new-ceo-tim-cook.13466/page-2, iterationId: 9d4a9a8c-f90e-4def-a9cb-1844ca37b07f\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.tomsguide.com/threads/8-questions-for-apples-new-ceo-tim-cook.13466/page-2, iterationId: 9d4a9a8c-f90e-4def-a9cb-1844ca37b07f\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343809}\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343809}, latency: 0\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.tomsguide.com/threads/8-questions-for-apples-new-ceo-tim-cook.13466/page-2, iterationId: 9d4a9a8c-f90e-4def-a9cb-1844ca37b07f\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.tomsguide.com/threads/8-questions-for-apples-new-ceo-tim-cook.13466/page-2, iterationId: 9d4a9a8c-f90e-4def-a9cb-1844ca37b07f\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.tomsguide.com/threads/8-questions-for-apples-new-ceo-tim-cook.13466/page-2, iterationId: 9d4a9a8c-f90e-4def-a9cb-1844ca37b07f\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 157, recordSize: 2484, indexRecordBytes: 387397\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.tomsguide.com/threads/8-questions-for-apples-new-ceo-tim-cook.13466/page-2, indexRecordsCount: 158, indexRecordsBytes: 389881, numRecordsNotCheckpointed: 158, iterationId: 9d4a9a8c-f90e-4def-a9cb-1844ca37b07f\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.tomsguide.com/threads/8-questions-for-apples-new-ceo-tim-cook.13466/page-2, iterationId: 9d4a9a8c-f90e-4def-a9cb-1844ca37b07f\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343809}\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343809}, latency: 0\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 9d4a9a8c-f90e-4def-a9cb-1844ca37b07f, iterationLatency: 12\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 42bbb300-40bf-430f-a597-2a1609327b7f\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343809}\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343809}, latency: 0\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 42bbb300-40bf-430f-a597-2a1609327b7f\\\",\\\"ts\\\":1710091343809,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 8\\\",\\\"ts\\\":1710091343817,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343817,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343817,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.x-pilot.com/forums/forum/163-support/, iterationId: 42bbb300-40bf-430f-a597-2a1609327b7f\\\",\\\"ts\\\":1710091343817,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.x-pilot.com/forums/forum/163-support/, iterationId: 42bbb300-40bf-430f-a597-2a1609327b7f\\\",\\\"ts\\\":1710091343817,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343817,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343817}\\\",\\\"ts\\\":1710091343818,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343817}, latency: 0\\\",\\\"ts\\\":1710091343818,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.x-pilot.com/forums/forum/163-support/, iterationId: 42bbb300-40bf-430f-a597-2a1609327b7f\\\",\\\"ts\\\":1710091343818,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.x-pilot.com/forums/forum/163-support/, iterationId: 42bbb300-40bf-430f-a597-2a1609327b7f\\\",\\\"ts\\\":1710091343818,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.x-pilot.com/forums/forum/163-support/, iterationId: 42bbb300-40bf-430f-a597-2a1609327b7f\\\",\\\"ts\\\":1710091343818,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 158, recordSize: 933, indexRecordBytes: 389881\\\",\\\"ts\\\":1710091343818,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.x-pilot.com/forums/forum/163-support/, indexRecordsCount: 159, indexRecordsBytes: 390814, numRecordsNotCheckpointed: 159, iterationId: 42bbb300-40bf-430f-a597-2a1609327b7f\\\",\\\"ts\\\":1710091343818,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.x-pilot.com/forums/forum/163-support/, iterationId: 42bbb300-40bf-430f-a597-2a1609327b7f\\\",\\\"ts\\\":1710091343818,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343818}\\\",\\\"ts\\\":1710091343818,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343818}, latency: 0\\\",\\\"ts\\\":1710091343818,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 42bbb300-40bf-430f-a597-2a1609327b7f, iterationLatency: 9\\\",\\\"ts\\\":1710091343818,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: d32b616a-25a6-417f-a268-f91275daef91\\\",\\\"ts\\\":1710091343818,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343818}\\\",\\\"ts\\\":1710091343818,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343818}, latency: 0\\\",\\\"ts\\\":1710091343818,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: d32b616a-25a6-417f-a268-f91275daef91\\\",\\\"ts\\\":1710091343818,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 20\\\",\\\"ts\\\":1710091343838,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343838,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343838,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.zabavasrb.net/ucp.php?mode\\\\u003ddelete_cookies\\\\u0026sid\\\\u003d17eba29deca29bc51232bdd2219e5f90, iterationId: d32b616a-25a6-417f-a268-f91275daef91\\\",\\\"ts\\\":1710091343838,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.zabavasrb.net/ucp.php?mode\\\\u003ddelete_cookies\\\\u0026sid\\\\u003d17eba29deca29bc51232bdd2219e5f90, iterationId: d32b616a-25a6-417f-a268-f91275daef91\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343839}\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343839}, latency: 0\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.zabavasrb.net/ucp.php?mode\\\\u003ddelete_cookies\\\\u0026sid\\\\u003d17eba29deca29bc51232bdd2219e5f90, iterationId: d32b616a-25a6-417f-a268-f91275daef91\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.zabavasrb.net/ucp.php?mode\\\\u003ddelete_cookies\\\\u0026sid\\\\u003d17eba29deca29bc51232bdd2219e5f90, iterationId: d32b616a-25a6-417f-a268-f91275daef91\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.zabavasrb.net/ucp.php?mode\\\\u003ddelete_cookies\\\\u0026sid\\\\u003d17eba29deca29bc51232bdd2219e5f90, iterationId: d32b616a-25a6-417f-a268-f91275daef91\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 159, recordSize: 577, indexRecordBytes: 390814\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.zabavasrb.net/ucp.php?mode\\\\u003ddelete_cookies\\\\u0026sid\\\\u003d17eba29deca29bc51232bdd2219e5f90, indexRecordsCount: 160, indexRecordsBytes: 391391, numRecordsNotCheckpointed: 160, iterationId: d32b616a-25a6-417f-a268-f91275daef91\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.zabavasrb.net/ucp.php?mode\\\\u003ddelete_cookies\\\\u0026sid\\\\u003d17eba29deca29bc51232bdd2219e5f90, iterationId: d32b616a-25a6-417f-a268-f91275daef91\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343839}\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343839}, latency: 0\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: d32b616a-25a6-417f-a268-f91275daef91, iterationLatency: 21\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 17ebf3a5-1251-4dee-8d9f-ec3624f55725\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343839}\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343839}, latency: 0\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 17ebf3a5-1251-4dee-8d9f-ec3624f55725\\\",\\\"ts\\\":1710091343839,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 10\\\",\\\"ts\\\":1710091343849,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343849,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forums.zotero.org/discussion/105216/windows-11-blocking-zotero, iterationId: 17ebf3a5-1251-4dee-8d9f-ec3624f55725\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forums.zotero.org/discussion/105216/windows-11-blocking-zotero, iterationId: 17ebf3a5-1251-4dee-8d9f-ec3624f55725\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343850}\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343850}, latency: 0\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forums.zotero.org/discussion/105216/windows-11-blocking-zotero, iterationId: 17ebf3a5-1251-4dee-8d9f-ec3624f55725\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forums.zotero.org/discussion/105216/windows-11-blocking-zotero, iterationId: 17ebf3a5-1251-4dee-8d9f-ec3624f55725\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forums.zotero.org/discussion/105216/windows-11-blocking-zotero, iterationId: 17ebf3a5-1251-4dee-8d9f-ec3624f55725\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 160, recordSize: 1179, indexRecordBytes: 391391\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forums.zotero.org/discussion/105216/windows-11-blocking-zotero, indexRecordsCount: 161, indexRecordsBytes: 392570, numRecordsNotCheckpointed: 161, iterationId: 17ebf3a5-1251-4dee-8d9f-ec3624f55725\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forums.zotero.org/discussion/105216/windows-11-blocking-zotero, iterationId: 17ebf3a5-1251-4dee-8d9f-ec3624f55725\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343850}\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343850}, latency: 0\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 17ebf3a5-1251-4dee-8d9f-ec3624f55725, iterationLatency: 11\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: c947eb3c-6365-4cec-ab9d-bd673623fa29\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343850}\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343850}, latency: 0\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: c947eb3c-6365-4cec-ab9d-bd673623fa29\\\",\\\"ts\\\":1710091343850,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 10\\\",\\\"ts\\\":1710091343860,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343860,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343860,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forumsaudedigital.com.br/2018/12/20/reajuste-de-planos-individuais-tera-nova-metodologia-de-calculo-a-partir-de-2019/, iterationId: c947eb3c-6365-4cec-ab9d-bd673623fa29\\\",\\\"ts\\\":1710091343860,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forumsaudedigital.com.br/2018/12/20/reajuste-de-planos-individuais-tera-nova-metodologia-de-calculo-a-partir-de-2019/, iterationId: c947eb3c-6365-4cec-ab9d-bd673623fa29\\\",\\\"ts\\\":1710091343860,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343860}\\\",\\\"ts\\\":1710091343860,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343860}, latency: 0\\\",\\\"ts\\\":1710091343860,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forumsaudedigital.com.br/2018/12/20/reajuste-de-planos-individuais-tera-nova-metodologia-de-calculo-a-partir-de-2019/, iterationId: c947eb3c-6365-4cec-ab9d-bd673623fa29\\\",\\\"ts\\\":1710091343860,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forumsaudedigital.com.br/2018/12/20/reajuste-de-planos-individuais-tera-nova-metodologia-de-calculo-a-partir-de-2019/, iterationId: c947eb3c-6365-4cec-ab9d-bd673623fa29\\\",\\\"ts\\\":1710091343860,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343860,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forumsaudedigital.com.br/2018/12/20/reajuste-de-planos-individuais-tera-nova-metodologia-de-calculo-a-partir-de-2019/, iterationId: c947eb3c-6365-4cec-ab9d-bd673623fa29\\\",\\\"ts\\\":1710091343860,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 161, recordSize: 1929, indexRecordBytes: 392570\\\",\\\"ts\\\":1710091343860,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forumsaudedigital.com.br/2018/12/20/reajuste-de-planos-individuais-tera-nova-metodologia-de-calculo-a-partir-de-2019/, indexRecordsCount: 162, indexRecordsBytes: 394499, numRecordsNotCheckpointed: 162, iterationId: c947eb3c-6365-4cec-ab9d-bd673623fa29\\\",\\\"ts\\\":1710091343861,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forumsaudedigital.com.br/2018/12/20/reajuste-de-planos-individuais-tera-nova-metodologia-de-calculo-a-partir-de-2019/, iterationId: c947eb3c-6365-4cec-ab9d-bd673623fa29\\\",\\\"ts\\\":1710091343861,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343861}\\\",\\\"ts\\\":1710091343861,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343861}, latency: 0\\\",\\\"ts\\\":1710091343861,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: c947eb3c-6365-4cec-ab9d-bd673623fa29, iterationLatency: 11\\\",\\\"ts\\\":1710091343861,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 7ff5741f-440a-4253-a0ca-32e0b9e7529b\\\",\\\"ts\\\":1710091343861,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343861}\\\",\\\"ts\\\":1710091343861,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343861}, latency: 0\\\",\\\"ts\\\":1710091343861,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 7ff5741f-440a-4253-a0ca-32e0b9e7529b\\\",\\\"ts\\\":1710091343861,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091343872,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forumspb.com/en/archive/2019/programme/52884/, iterationId: 7ff5741f-440a-4253-a0ca-32e0b9e7529b\\\",\\\"ts\\\":1710091343872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forumspb.com/en/archive/2019/programme/52884/, iterationId: 7ff5741f-440a-4253-a0ca-32e0b9e7529b\\\",\\\"ts\\\":1710091343872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343872}\\\",\\\"ts\\\":1710091343872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343872}, latency: 0\\\",\\\"ts\\\":1710091343872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forumspb.com/en/archive/2019/programme/52884/, iterationId: 7ff5741f-440a-4253-a0ca-32e0b9e7529b\\\",\\\"ts\\\":1710091343872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forumspb.com/en/archive/2019/programme/52884/, iterationId: 7ff5741f-440a-4253-a0ca-32e0b9e7529b\\\",\\\"ts\\\":1710091343872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343872,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forumspb.com/en/archive/2019/programme/52884/, iterationId: 7ff5741f-440a-4253-a0ca-32e0b9e7529b\\\",\\\"ts\\\":1710091343873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 162, recordSize: 6952, indexRecordBytes: 394499\\\",\\\"ts\\\":1710091343873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forumspb.com/en/archive/2019/programme/52884/, indexRecordsCount: 163, indexRecordsBytes: 401451, numRecordsNotCheckpointed: 163, iterationId: 7ff5741f-440a-4253-a0ca-32e0b9e7529b\\\",\\\"ts\\\":1710091343873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forumspb.com/en/archive/2019/programme/52884/, iterationId: 7ff5741f-440a-4253-a0ca-32e0b9e7529b\\\",\\\"ts\\\":1710091343873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343873}\\\",\\\"ts\\\":1710091343873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343873}, latency: 0\\\",\\\"ts\\\":1710091343873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 7ff5741f-440a-4253-a0ca-32e0b9e7529b, iterationLatency: 12\\\",\\\"ts\\\":1710091343873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 41ac47ed-8b91-49b5-9ca4-22413c40b29b\\\",\\\"ts\\\":1710091343873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343873}\\\",\\\"ts\\\":1710091343873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343873}, latency: 0\\\",\\\"ts\\\":1710091343873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 41ac47ed-8b91-49b5-9ca4-22413c40b29b\\\",\\\"ts\\\":1710091343873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 13\\\",\\\"ts\\\":1710091343885,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forumspb.com/en/archive/2019/programme/54747/, iterationId: 41ac47ed-8b91-49b5-9ca4-22413c40b29b\\\",\\\"ts\\\":1710091343885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forumspb.com/en/archive/2019/programme/54747/, iterationId: 41ac47ed-8b91-49b5-9ca4-22413c40b29b\\\",\\\"ts\\\":1710091343885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343885}\\\",\\\"ts\\\":1710091343885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343885,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343885}, latency: 0\\\",\\\"ts\\\":1710091343885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forumspb.com/en/archive/2019/programme/54747/, iterationId: 41ac47ed-8b91-49b5-9ca4-22413c40b29b\\\",\\\"ts\\\":1710091343886,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forumspb.com/en/archive/2019/programme/54747/, iterationId: 41ac47ed-8b91-49b5-9ca4-22413c40b29b\\\",\\\"ts\\\":1710091343886,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forumspb.com/en/archive/2019/programme/54747/, iterationId: 41ac47ed-8b91-49b5-9ca4-22413c40b29b\\\",\\\"ts\\\":1710091343886,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 163, recordSize: 6788, indexRecordBytes: 401451\\\",\\\"ts\\\":1710091343887,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forumspb.com/en/archive/2019/programme/54747/, indexRecordsCount: 164, indexRecordsBytes: 408239, numRecordsNotCheckpointed: 164, iterationId: 41ac47ed-8b91-49b5-9ca4-22413c40b29b\\\",\\\"ts\\\":1710091343887,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forumspb.com/en/archive/2019/programme/54747/, iterationId: 41ac47ed-8b91-49b5-9ca4-22413c40b29b\\\",\\\"ts\\\":1710091343887,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343887}\\\",\\\"ts\\\":1710091343887,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343887}, latency: 0\\\",\\\"ts\\\":1710091343887,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 41ac47ed-8b91-49b5-9ca4-22413c40b29b, iterationLatency: 14\\\",\\\"ts\\\":1710091343887,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 0c24ae6b-4fe0-448e-8fed-5d5beb1d6ea5\\\",\\\"ts\\\":1710091343887,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343887}\\\",\\\"ts\\\":1710091343887,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343887}, latency: 0\\\",\\\"ts\\\":1710091343887,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 0c24ae6b-4fe0-448e-8fed-5d5beb1d6ea5\\\",\\\"ts\\\":1710091343887,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091343896,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forumstomatologiczne.pl/forum/prosze-o-pomoc/watek/1500722/1, iterationId: 0c24ae6b-4fe0-448e-8fed-5d5beb1d6ea5\\\",\\\"ts\\\":1710091343896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forumstomatologiczne.pl/forum/prosze-o-pomoc/watek/1500722/1, iterationId: 0c24ae6b-4fe0-448e-8fed-5d5beb1d6ea5\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343897}\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343897}, latency: 0\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forumstomatologiczne.pl/forum/prosze-o-pomoc/watek/1500722/1, iterationId: 0c24ae6b-4fe0-448e-8fed-5d5beb1d6ea5\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forumstomatologiczne.pl/forum/prosze-o-pomoc/watek/1500722/1, iterationId: 0c24ae6b-4fe0-448e-8fed-5d5beb1d6ea5\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forumstomatologiczne.pl/forum/prosze-o-pomoc/watek/1500722/1, iterationId: 0c24ae6b-4fe0-448e-8fed-5d5beb1d6ea5\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 164, recordSize: 1111, indexRecordBytes: 408239\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forumstomatologiczne.pl/forum/prosze-o-pomoc/watek/1500722/1, indexRecordsCount: 165, indexRecordsBytes: 409350, numRecordsNotCheckpointed: 165, iterationId: 0c24ae6b-4fe0-448e-8fed-5d5beb1d6ea5\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forumstomatologiczne.pl/forum/prosze-o-pomoc/watek/1500722/1, iterationId: 0c24ae6b-4fe0-448e-8fed-5d5beb1d6ea5\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343897}\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343897}, latency: 0\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 0c24ae6b-4fe0-448e-8fed-5d5beb1d6ea5, iterationLatency: 10\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 7429418a-7bd7-41bf-ae00-6c06fd005f47\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343897}\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343897}, latency: 0\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 7429418a-7bd7-41bf-ae00-6c06fd005f47\\\",\\\"ts\\\":1710091343897,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091343908,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343908,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343908,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forumsvt.site.ac-strasbourg.fr/ucp.php?mode\\\\u003dregister\\\\u0026sid\\\\u003dbf94f6e006fca7933cd1614f60c05a6a, iterationId: 7429418a-7bd7-41bf-ae00-6c06fd005f47\\\",\\\"ts\\\":1710091343908,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forumsvt.site.ac-strasbourg.fr/ucp.php?mode\\\\u003dregister\\\\u0026sid\\\\u003dbf94f6e006fca7933cd1614f60c05a6a, iterationId: 7429418a-7bd7-41bf-ae00-6c06fd005f47\\\",\\\"ts\\\":1710091343908,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343908,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343908}\\\",\\\"ts\\\":1710091343908,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343908}, latency: 0\\\",\\\"ts\\\":1710091343908,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forumsvt.site.ac-strasbourg.fr/ucp.php?mode\\\\u003dregister\\\\u0026sid\\\\u003dbf94f6e006fca7933cd1614f60c05a6a, iterationId: 7429418a-7bd7-41bf-ae00-6c06fd005f47\\\",\\\"ts\\\":1710091343908,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forumsvt.site.ac-strasbourg.fr/ucp.php?mode\\\\u003dregister\\\\u0026sid\\\\u003dbf94f6e006fca7933cd1614f60c05a6a, iterationId: 7429418a-7bd7-41bf-ae00-6c06fd005f47\\\",\\\"ts\\\":1710091343908,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forumsvt.site.ac-strasbourg.fr/ucp.php?mode\\\\u003dregister\\\\u0026sid\\\\u003dbf94f6e006fca7933cd1614f60c05a6a, iterationId: 7429418a-7bd7-41bf-ae00-6c06fd005f47\\\",\\\"ts\\\":1710091343908,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 165, recordSize: 1699, indexRecordBytes: 409350\\\",\\\"ts\\\":1710091343909,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forumsvt.site.ac-strasbourg.fr/ucp.php?mode\\\\u003dregister\\\\u0026sid\\\\u003dbf94f6e006fca7933cd1614f60c05a6a, indexRecordsCount: 166, indexRecordsBytes: 411049, numRecordsNotCheckpointed: 166, iterationId: 7429418a-7bd7-41bf-ae00-6c06fd005f47\\\",\\\"ts\\\":1710091343909,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forumsvt.site.ac-strasbourg.fr/ucp.php?mode\\\\u003dregister\\\\u0026sid\\\\u003dbf94f6e006fca7933cd1614f60c05a6a, iterationId: 7429418a-7bd7-41bf-ae00-6c06fd005f47\\\",\\\"ts\\\":1710091343909,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343909}\\\",\\\"ts\\\":1710091343909,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343909}, latency: 0\\\",\\\"ts\\\":1710091343909,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 7429418a-7bd7-41bf-ae00-6c06fd005f47, iterationLatency: 12\\\",\\\"ts\\\":1710091343909,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: ef5daba5-8813-4af7-b819-68ad83dee1b6\\\",\\\"ts\\\":1710091343909,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343909}\\\",\\\"ts\\\":1710091343909,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343909}, latency: 0\\\",\\\"ts\\\":1710091343909,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: ef5daba5-8813-4af7-b819-68ad83dee1b6\\\",\\\"ts\\\":1710091343909,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 14\\\",\\\"ts\\\":1710091343922,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forus.surakarta.go.id/search.php?search_id\\\\u003dactive_topics\\\\u0026sid\\\\u003d242d4e0e8b3a7acb3de2a06488e5f8d8, iterationId: ef5daba5-8813-4af7-b819-68ad83dee1b6\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forus.surakarta.go.id/search.php?search_id\\\\u003dactive_topics\\\\u0026sid\\\\u003d242d4e0e8b3a7acb3de2a06488e5f8d8, iterationId: ef5daba5-8813-4af7-b819-68ad83dee1b6\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343923}\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343923}, latency: 0\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forus.surakarta.go.id/search.php?search_id\\\\u003dactive_topics\\\\u0026sid\\\\u003d242d4e0e8b3a7acb3de2a06488e5f8d8, iterationId: ef5daba5-8813-4af7-b819-68ad83dee1b6\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forus.surakarta.go.id/search.php?search_id\\\\u003dactive_topics\\\\u0026sid\\\\u003d242d4e0e8b3a7acb3de2a06488e5f8d8, iterationId: ef5daba5-8813-4af7-b819-68ad83dee1b6\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forus.surakarta.go.id/search.php?search_id\\\\u003dactive_topics\\\\u0026sid\\\\u003d242d4e0e8b3a7acb3de2a06488e5f8d8, iterationId: ef5daba5-8813-4af7-b819-68ad83dee1b6\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 166, recordSize: 568, indexRecordBytes: 411049\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forus.surakarta.go.id/search.php?search_id\\\\u003dactive_topics\\\\u0026sid\\\\u003d242d4e0e8b3a7acb3de2a06488e5f8d8, indexRecordsCount: 167, indexRecordsBytes: 411617, numRecordsNotCheckpointed: 167, iterationId: ef5daba5-8813-4af7-b819-68ad83dee1b6\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forus.surakarta.go.id/search.php?search_id\\\\u003dactive_topics\\\\u0026sid\\\\u003d242d4e0e8b3a7acb3de2a06488e5f8d8, iterationId: ef5daba5-8813-4af7-b819-68ad83dee1b6\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343923}\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343923}, latency: 0\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: ef5daba5-8813-4af7-b819-68ad83dee1b6, iterationLatency: 14\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 45b45378-4dd0-4379-8973-5801446da1fe\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343923}\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343923}, latency: 0\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 45b45378-4dd0-4379-8973-5801446da1fe\\\",\\\"ts\\\":1710091343923,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091343934,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343934,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343934,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forward.recentiprogressi.it/it/tag/diagnosi-precoce/, iterationId: 45b45378-4dd0-4379-8973-5801446da1fe\\\",\\\"ts\\\":1710091343934,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forward.recentiprogressi.it/it/tag/diagnosi-precoce/, iterationId: 45b45378-4dd0-4379-8973-5801446da1fe\\\",\\\"ts\\\":1710091343934,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343934}\\\",\\\"ts\\\":1710091343934,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343934}, latency: 0\\\",\\\"ts\\\":1710091343934,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forward.recentiprogressi.it/it/tag/diagnosi-precoce/, iterationId: 45b45378-4dd0-4379-8973-5801446da1fe\\\",\\\"ts\\\":1710091343934,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forward.recentiprogressi.it/it/tag/diagnosi-precoce/, iterationId: 45b45378-4dd0-4379-8973-5801446da1fe\\\",\\\"ts\\\":1710091343934,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343934,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forward.recentiprogressi.it/it/tag/diagnosi-precoce/, iterationId: 45b45378-4dd0-4379-8973-5801446da1fe\\\",\\\"ts\\\":1710091343935,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 167, recordSize: 1278, indexRecordBytes: 411617\\\",\\\"ts\\\":1710091343935,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forward.recentiprogressi.it/it/tag/diagnosi-precoce/, indexRecordsCount: 168, indexRecordsBytes: 412895, numRecordsNotCheckpointed: 168, iterationId: 45b45378-4dd0-4379-8973-5801446da1fe\\\",\\\"ts\\\":1710091343935,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forward.recentiprogressi.it/it/tag/diagnosi-precoce/, iterationId: 45b45378-4dd0-4379-8973-5801446da1fe\\\",\\\"ts\\\":1710091343935,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343935}\\\",\\\"ts\\\":1710091343935,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343935}, latency: 0\\\",\\\"ts\\\":1710091343935,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 45b45378-4dd0-4379-8973-5801446da1fe, iterationLatency: 12\\\",\\\"ts\\\":1710091343935,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: ef125776-1f91-437f-acf8-0aa0a2a1bd5a\\\",\\\"ts\\\":1710091343935,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343935}\\\",\\\"ts\\\":1710091343935,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343935}, latency: 0\\\",\\\"ts\\\":1710091343935,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: ef125776-1f91-437f-acf8-0aa0a2a1bd5a\\\",\\\"ts\\\":1710091343935,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 50\\\",\\\"ts\\\":1710091343985,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091343985,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091343986,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forwardwithdesign.com/products/free-fwd-womens-pleated-crew-new?variant\\\\u003d39862116450385, iterationId: ef125776-1f91-437f-acf8-0aa0a2a1bd5a\\\",\\\"ts\\\":1710091343986,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forwardwithdesign.com/products/free-fwd-womens-pleated-crew-new?variant\\\\u003d39862116450385, iterationId: ef125776-1f91-437f-acf8-0aa0a2a1bd5a\\\",\\\"ts\\\":1710091343986,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091343986,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343986}\\\",\\\"ts\\\":1710091343986,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343986}, latency: 0\\\",\\\"ts\\\":1710091343986,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forwardwithdesign.com/products/free-fwd-womens-pleated-crew-new?variant\\\\u003d39862116450385, iterationId: ef125776-1f91-437f-acf8-0aa0a2a1bd5a\\\",\\\"ts\\\":1710091343986,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forwardwithdesign.com/products/free-fwd-womens-pleated-crew-new?variant\\\\u003d39862116450385, iterationId: ef125776-1f91-437f-acf8-0aa0a2a1bd5a\\\",\\\"ts\\\":1710091343986,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forwardwithdesign.com/products/free-fwd-womens-pleated-crew-new?variant\\\\u003d39862116450385, iterationId: ef125776-1f91-437f-acf8-0aa0a2a1bd5a\\\",\\\"ts\\\":1710091343986,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 168, recordSize: 2707, indexRecordBytes: 412895\\\",\\\"ts\\\":1710091343986,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forwardwithdesign.com/products/free-fwd-womens-pleated-crew-new?variant\\\\u003d39862116450385, indexRecordsCount: 169, indexRecordsBytes: 415602, numRecordsNotCheckpointed: 169, iterationId: ef125776-1f91-437f-acf8-0aa0a2a1bd5a\\\",\\\"ts\\\":1710091343986,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forwardwithdesign.com/products/free-fwd-womens-pleated-crew-new?variant\\\\u003d39862116450385, iterationId: ef125776-1f91-437f-acf8-0aa0a2a1bd5a\\\",\\\"ts\\\":1710091343986,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343986}\\\",\\\"ts\\\":1710091343986,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343986}, latency: 0\\\",\\\"ts\\\":1710091343986,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: ef125776-1f91-437f-acf8-0aa0a2a1bd5a, iterationLatency: 51\\\",\\\"ts\\\":1710091343986,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 13788a1d-e465-460b-8782-11f10d782915\\\",\\\"ts\\\":1710091343987,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343987}\\\",\\\"ts\\\":1710091343987,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091343987}, latency: 0\\\",\\\"ts\\\":1710091343987,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:23 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 13788a1d-e465-460b-8782-11f10d782915\\\",\\\"ts\\\":1710091343987,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 21\\\",\\\"ts\\\":1710091344007,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://forwart.co/product/yumiko-yoneda-round-68x12cm/, iterationId: 13788a1d-e465-460b-8782-11f10d782915\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://forwart.co/product/yumiko-yoneda-round-68x12cm/, iterationId: 13788a1d-e465-460b-8782-11f10d782915\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344008}\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344008}, latency: 0\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://forwart.co/product/yumiko-yoneda-round-68x12cm/, iterationId: 13788a1d-e465-460b-8782-11f10d782915\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://forwart.co/product/yumiko-yoneda-round-68x12cm/, iterationId: 13788a1d-e465-460b-8782-11f10d782915\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://forwart.co/product/yumiko-yoneda-round-68x12cm/, iterationId: 13788a1d-e465-460b-8782-11f10d782915\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 169, recordSize: 1670, indexRecordBytes: 415602\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://forwart.co/product/yumiko-yoneda-round-68x12cm/, indexRecordsCount: 170, indexRecordsBytes: 417272, numRecordsNotCheckpointed: 170, iterationId: 13788a1d-e465-460b-8782-11f10d782915\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://forwart.co/product/yumiko-yoneda-round-68x12cm/, iterationId: 13788a1d-e465-460b-8782-11f10d782915\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344008}\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344008}, latency: 0\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 13788a1d-e465-460b-8782-11f10d782915, iterationLatency: 21\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 3f69266a-4044-4de5-b8f6-657e8b57464d\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344008}\\\",\\\"ts\\\":1710091344008,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344008}, latency: 0\\\",\\\"ts\\\":1710091344009,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 3f69266a-4044-4de5-b8f6-657e8b57464d\\\",\\\"ts\\\":1710091344009,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 47\\\",\\\"ts\\\":1710091344055,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fosterandblack.com/, iterationId: 3f69266a-4044-4de5-b8f6-657e8b57464d\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fosterandblack.com/, iterationId: 3f69266a-4044-4de5-b8f6-657e8b57464d\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344056}\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344056}, latency: 0\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fosterandblack.com/, iterationId: 3f69266a-4044-4de5-b8f6-657e8b57464d\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fosterandblack.com/, iterationId: 3f69266a-4044-4de5-b8f6-657e8b57464d\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fosterandblack.com/, iterationId: 3f69266a-4044-4de5-b8f6-657e8b57464d\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 170, recordSize: 872, indexRecordBytes: 417272\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fosterandblack.com/, indexRecordsCount: 171, indexRecordsBytes: 418144, numRecordsNotCheckpointed: 171, iterationId: 3f69266a-4044-4de5-b8f6-657e8b57464d\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fosterandblack.com/, iterationId: 3f69266a-4044-4de5-b8f6-657e8b57464d\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344056}\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344056}, latency: 0\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 3f69266a-4044-4de5-b8f6-657e8b57464d, iterationLatency: 48\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: ef771a7b-cc2a-4183-ae99-e5c7f9c8ac9c\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344056}\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344056}, latency: 0\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: ef771a7b-cc2a-4183-ae99-e5c7f9c8ac9c\\\",\\\"ts\\\":1710091344056,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 36\\\",\\\"ts\\\":1710091344092,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344092,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344092,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fotobaca.pl/portfolio-tag/love/, iterationId: ef771a7b-cc2a-4183-ae99-e5c7f9c8ac9c\\\",\\\"ts\\\":1710091344092,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fotobaca.pl/portfolio-tag/love/, iterationId: ef771a7b-cc2a-4183-ae99-e5c7f9c8ac9c\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344093}\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344093}, latency: 0\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fotobaca.pl/portfolio-tag/love/, iterationId: ef771a7b-cc2a-4183-ae99-e5c7f9c8ac9c\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fotobaca.pl/portfolio-tag/love/, iterationId: ef771a7b-cc2a-4183-ae99-e5c7f9c8ac9c\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fotobaca.pl/portfolio-tag/love/, iterationId: ef771a7b-cc2a-4183-ae99-e5c7f9c8ac9c\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 171, recordSize: 1105, indexRecordBytes: 418144\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fotobaca.pl/portfolio-tag/love/, indexRecordsCount: 172, indexRecordsBytes: 419249, numRecordsNotCheckpointed: 172, iterationId: ef771a7b-cc2a-4183-ae99-e5c7f9c8ac9c\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fotobaca.pl/portfolio-tag/love/, iterationId: ef771a7b-cc2a-4183-ae99-e5c7f9c8ac9c\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344093}\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344093}, latency: 0\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: ef771a7b-cc2a-4183-ae99-e5c7f9c8ac9c, iterationLatency: 37\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 3190b6e4-5a79-4817-ac99-8dfbe64434b2\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344093}\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344093}, latency: 0\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 3190b6e4-5a79-4817-ac99-8dfbe64434b2\\\",\\\"ts\\\":1710091344093,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091344104,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344104,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344104,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fotofaka.com/24-beautiful-black-and-white-cat/, iterationId: 3190b6e4-5a79-4817-ac99-8dfbe64434b2\\\",\\\"ts\\\":1710091344104,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fotofaka.com/24-beautiful-black-and-white-cat/, iterationId: 3190b6e4-5a79-4817-ac99-8dfbe64434b2\\\",\\\"ts\\\":1710091344104,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344104}\\\",\\\"ts\\\":1710091344104,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344104,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344104}, latency: 0\\\",\\\"ts\\\":1710091344104,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fotofaka.com/24-beautiful-black-and-white-cat/, iterationId: 3190b6e4-5a79-4817-ac99-8dfbe64434b2\\\",\\\"ts\\\":1710091344105,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fotofaka.com/24-beautiful-black-and-white-cat/, iterationId: 3190b6e4-5a79-4817-ac99-8dfbe64434b2\\\",\\\"ts\\\":1710091344105,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fotofaka.com/24-beautiful-black-and-white-cat/, iterationId: 3190b6e4-5a79-4817-ac99-8dfbe64434b2\\\",\\\"ts\\\":1710091344105,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 172, recordSize: 1825, indexRecordBytes: 419249\\\",\\\"ts\\\":1710091344105,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fotofaka.com/24-beautiful-black-and-white-cat/, indexRecordsCount: 173, indexRecordsBytes: 421074, numRecordsNotCheckpointed: 173, iterationId: 3190b6e4-5a79-4817-ac99-8dfbe64434b2\\\",\\\"ts\\\":1710091344105,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fotofaka.com/24-beautiful-black-and-white-cat/, iterationId: 3190b6e4-5a79-4817-ac99-8dfbe64434b2\\\",\\\"ts\\\":1710091344105,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344105}\\\",\\\"ts\\\":1710091344105,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344105}, latency: 0\\\",\\\"ts\\\":1710091344105,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 3190b6e4-5a79-4817-ac99-8dfbe64434b2, iterationLatency: 12\\\",\\\"ts\\\":1710091344105,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 47b65b2e-ea03-41a7-9a81-ef24ef141bf5\\\",\\\"ts\\\":1710091344105,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344105}\\\",\\\"ts\\\":1710091344105,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344105}, latency: 0\\\",\\\"ts\\\":1710091344105,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 47b65b2e-ea03-41a7-9a81-ef24ef141bf5\\\",\\\"ts\\\":1710091344105,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 10\\\",\\\"ts\\\":1710091344115,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344115,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344115,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fotografie-sanchez.de/vintage-hochzeitsfotos-berlin/romantische-vintage-hochzeitsfotos-berlin-21/, iterationId: 47b65b2e-ea03-41a7-9a81-ef24ef141bf5\\\",\\\"ts\\\":1710091344115,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fotografie-sanchez.de/vintage-hochzeitsfotos-berlin/romantische-vintage-hochzeitsfotos-berlin-21/, iterationId: 47b65b2e-ea03-41a7-9a81-ef24ef141bf5\\\",\\\"ts\\\":1710091344115,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344115}\\\",\\\"ts\\\":1710091344115,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344115,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344115}, latency: 0\\\",\\\"ts\\\":1710091344116,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fotografie-sanchez.de/vintage-hochzeitsfotos-berlin/romantische-vintage-hochzeitsfotos-berlin-21/, iterationId: 47b65b2e-ea03-41a7-9a81-ef24ef141bf5\\\",\\\"ts\\\":1710091344116,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fotografie-sanchez.de/vintage-hochzeitsfotos-berlin/romantische-vintage-hochzeitsfotos-berlin-21/, iterationId: 47b65b2e-ea03-41a7-9a81-ef24ef141bf5\\\",\\\"ts\\\":1710091344116,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fotografie-sanchez.de/vintage-hochzeitsfotos-berlin/romantische-vintage-hochzeitsfotos-berlin-21/, iterationId: 47b65b2e-ea03-41a7-9a81-ef24ef141bf5\\\",\\\"ts\\\":1710091344116,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 173, recordSize: 1328, indexRecordBytes: 421074\\\",\\\"ts\\\":1710091344116,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fotografie-sanchez.de/vintage-hochzeitsfotos-berlin/romantische-vintage-hochzeitsfotos-berlin-21/, indexRecordsCount: 174, indexRecordsBytes: 422402, numRecordsNotCheckpointed: 174, iterationId: 47b65b2e-ea03-41a7-9a81-ef24ef141bf5\\\",\\\"ts\\\":1710091344116,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fotografie-sanchez.de/vintage-hochzeitsfotos-berlin/romantische-vintage-hochzeitsfotos-berlin-21/, iterationId: 47b65b2e-ea03-41a7-9a81-ef24ef141bf5\\\",\\\"ts\\\":1710091344116,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344116}\\\",\\\"ts\\\":1710091344116,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344116}, latency: 0\\\",\\\"ts\\\":1710091344116,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 47b65b2e-ea03-41a7-9a81-ef24ef141bf5, iterationLatency: 11\\\",\\\"ts\\\":1710091344116,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: ad9fb3cb-43a6-40a9-b661-30323753c941\\\",\\\"ts\\\":1710091344116,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344116}\\\",\\\"ts\\\":1710091344116,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344116}, latency: 0\\\",\\\"ts\\\":1710091344116,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: ad9fb3cb-43a6-40a9-b661-30323753c941\\\",\\\"ts\\\":1710091344116,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344128,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fotolabor.de/content.php?menue\\\\u003d900\\\\u0026Leistung\\\\u003dWebstores\\\\u0026bereich\\\\u003dstart_webstores.html, iterationId: ad9fb3cb-43a6-40a9-b661-30323753c941\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fotolabor.de/content.php?menue\\\\u003d900\\\\u0026Leistung\\\\u003dWebstores\\\\u0026bereich\\\\u003dstart_webstores.html, iterationId: ad9fb3cb-43a6-40a9-b661-30323753c941\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344129}\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344129}, latency: 0\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fotolabor.de/content.php?menue\\\\u003d900\\\\u0026Leistung\\\\u003dWebstores\\\\u0026bereich\\\\u003dstart_webstores.html, iterationId: ad9fb3cb-43a6-40a9-b661-30323753c941\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fotolabor.de/content.php?menue\\\\u003d900\\\\u0026Leistung\\\\u003dWebstores\\\\u0026bereich\\\\u003dstart_webstores.html, iterationId: ad9fb3cb-43a6-40a9-b661-30323753c941\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fotolabor.de/content.php?menue\\\\u003d900\\\\u0026Leistung\\\\u003dWebstores\\\\u0026bereich\\\\u003dstart_webstores.html, iterationId: ad9fb3cb-43a6-40a9-b661-30323753c941\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 174, recordSize: 1342, indexRecordBytes: 422402\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fotolabor.de/content.php?menue\\\\u003d900\\\\u0026Leistung\\\\u003dWebstores\\\\u0026bereich\\\\u003dstart_webstores.html, indexRecordsCount: 175, indexRecordsBytes: 423744, numRecordsNotCheckpointed: 175, iterationId: ad9fb3cb-43a6-40a9-b661-30323753c941\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fotolabor.de/content.php?menue\\\\u003d900\\\\u0026Leistung\\\\u003dWebstores\\\\u0026bereich\\\\u003dstart_webstores.html, iterationId: ad9fb3cb-43a6-40a9-b661-30323753c941\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344129}\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344129}, latency: 0\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: ad9fb3cb-43a6-40a9-b661-30323753c941, iterationLatency: 13\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 489433b6-3335-48cb-bf40-d4816ea5619c\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344129}\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344129}, latency: 0\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 489433b6-3335-48cb-bf40-d4816ea5619c\\\",\\\"ts\\\":1710091344129,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344141,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344141,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344141,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fotopolka.ru/sarafan, iterationId: 489433b6-3335-48cb-bf40-d4816ea5619c\\\",\\\"ts\\\":1710091344141,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344142,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fotopolka.ru/sarafan, iterationId: 489433b6-3335-48cb-bf40-d4816ea5619c\\\",\\\"ts\\\":1710091344142,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344142}\\\",\\\"ts\\\":1710091344142,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344142}, latency: 0\\\",\\\"ts\\\":1710091344142,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fotopolka.ru/sarafan, iterationId: 489433b6-3335-48cb-bf40-d4816ea5619c\\\",\\\"ts\\\":1710091344142,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fotopolka.ru/sarafan, iterationId: 489433b6-3335-48cb-bf40-d4816ea5619c\\\",\\\"ts\\\":1710091344142,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fotopolka.ru/sarafan, iterationId: 489433b6-3335-48cb-bf40-d4816ea5619c\\\",\\\"ts\\\":1710091344142,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 175, recordSize: 2386, indexRecordBytes: 423744\\\",\\\"ts\\\":1710091344142,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fotopolka.ru/sarafan, indexRecordsCount: 176, indexRecordsBytes: 426130, numRecordsNotCheckpointed: 176, iterationId: 489433b6-3335-48cb-bf40-d4816ea5619c\\\",\\\"ts\\\":1710091344142,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fotopolka.ru/sarafan, iterationId: 489433b6-3335-48cb-bf40-d4816ea5619c\\\",\\\"ts\\\":1710091344142,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344142}\\\",\\\"ts\\\":1710091344142,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344142}, latency: 0\\\",\\\"ts\\\":1710091344142,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 489433b6-3335-48cb-bf40-d4816ea5619c, iterationLatency: 13\\\",\\\"ts\\\":1710091344142,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 36dafeb5-8e2e-4766-9b3f-7b64c51b14b5\\\",\\\"ts\\\":1710091344142,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344142}\\\",\\\"ts\\\":1710091344142,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344142}, latency: 0\\\",\\\"ts\\\":1710091344143,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 36dafeb5-8e2e-4766-9b3f-7b64c51b14b5\\\",\\\"ts\\\":1710091344143,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 13\\\",\\\"ts\\\":1710091344155,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344155,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344155,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fotoshop.wlz-online.de/5652030/mehlen?l\\\\u003dde, iterationId: 36dafeb5-8e2e-4766-9b3f-7b64c51b14b5\\\",\\\"ts\\\":1710091344155,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fotoshop.wlz-online.de/5652030/mehlen?l\\\\u003dde, iterationId: 36dafeb5-8e2e-4766-9b3f-7b64c51b14b5\\\",\\\"ts\\\":1710091344155,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344155,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344155}\\\",\\\"ts\\\":1710091344155,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344155}, latency: 0\\\",\\\"ts\\\":1710091344155,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fotoshop.wlz-online.de/5652030/mehlen?l\\\\u003dde, iterationId: 36dafeb5-8e2e-4766-9b3f-7b64c51b14b5\\\",\\\"ts\\\":1710091344155,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fotoshop.wlz-online.de/5652030/mehlen?l\\\\u003dde, iterationId: 36dafeb5-8e2e-4766-9b3f-7b64c51b14b5\\\",\\\"ts\\\":1710091344155,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fotoshop.wlz-online.de/5652030/mehlen?l\\\\u003dde, iterationId: 36dafeb5-8e2e-4766-9b3f-7b64c51b14b5\\\",\\\"ts\\\":1710091344156,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 176, recordSize: 1384, indexRecordBytes: 426130\\\",\\\"ts\\\":1710091344156,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fotoshop.wlz-online.de/5652030/mehlen?l\\\\u003dde, indexRecordsCount: 177, indexRecordsBytes: 427514, numRecordsNotCheckpointed: 177, iterationId: 36dafeb5-8e2e-4766-9b3f-7b64c51b14b5\\\",\\\"ts\\\":1710091344156,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fotoshop.wlz-online.de/5652030/mehlen?l\\\\u003dde, iterationId: 36dafeb5-8e2e-4766-9b3f-7b64c51b14b5\\\",\\\"ts\\\":1710091344156,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344156}\\\",\\\"ts\\\":1710091344156,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344156}, latency: 0\\\",\\\"ts\\\":1710091344156,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 36dafeb5-8e2e-4766-9b3f-7b64c51b14b5, iterationLatency: 14\\\",\\\"ts\\\":1710091344156,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: a3b2a230-62ff-4be6-aee3-547a74421715\\\",\\\"ts\\\":1710091344156,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344156}\\\",\\\"ts\\\":1710091344156,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344156}, latency: 0\\\",\\\"ts\\\":1710091344156,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: a3b2a230-62ff-4be6-aee3-547a74421715\\\",\\\"ts\\\":1710091344156,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091344166,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344166,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344166,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fotosifichi.com/?attachment_id\\\\u003d537, iterationId: a3b2a230-62ff-4be6-aee3-547a74421715\\\",\\\"ts\\\":1710091344166,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fotosifichi.com/?attachment_id\\\\u003d537, iterationId: a3b2a230-62ff-4be6-aee3-547a74421715\\\",\\\"ts\\\":1710091344166,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344167}\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344167}, latency: 0\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fotosifichi.com/?attachment_id\\\\u003d537, iterationId: a3b2a230-62ff-4be6-aee3-547a74421715\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fotosifichi.com/?attachment_id\\\\u003d537, iterationId: a3b2a230-62ff-4be6-aee3-547a74421715\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fotosifichi.com/?attachment_id\\\\u003d537, iterationId: a3b2a230-62ff-4be6-aee3-547a74421715\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 177, recordSize: 519, indexRecordBytes: 427514\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fotosifichi.com/?attachment_id\\\\u003d537, indexRecordsCount: 178, indexRecordsBytes: 428033, numRecordsNotCheckpointed: 178, iterationId: a3b2a230-62ff-4be6-aee3-547a74421715\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fotosifichi.com/?attachment_id\\\\u003d537, iterationId: a3b2a230-62ff-4be6-aee3-547a74421715\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344167}\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344167}, latency: 0\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: a3b2a230-62ff-4be6-aee3-547a74421715, iterationLatency: 11\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: d5701f65-41b2-44d9-b225-1762a0ea5079\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344167}\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344167}, latency: 0\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: d5701f65-41b2-44d9-b225-1762a0ea5079\\\",\\\"ts\\\":1710091344167,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 9\\\",\\\"ts\\\":1710091344176,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fototer.oszk.hu/elso-vilaghaboru/121450/, iterationId: d5701f65-41b2-44d9-b225-1762a0ea5079\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fototer.oszk.hu/elso-vilaghaboru/121450/, iterationId: d5701f65-41b2-44d9-b225-1762a0ea5079\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344177}\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344177}, latency: 0\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fototer.oszk.hu/elso-vilaghaboru/121450/, iterationId: d5701f65-41b2-44d9-b225-1762a0ea5079\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fototer.oszk.hu/elso-vilaghaboru/121450/, iterationId: d5701f65-41b2-44d9-b225-1762a0ea5079\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fototer.oszk.hu/elso-vilaghaboru/121450/, iterationId: d5701f65-41b2-44d9-b225-1762a0ea5079\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 178, recordSize: 1046, indexRecordBytes: 428033\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fototer.oszk.hu/elso-vilaghaboru/121450/, indexRecordsCount: 179, indexRecordsBytes: 429079, numRecordsNotCheckpointed: 179, iterationId: d5701f65-41b2-44d9-b225-1762a0ea5079\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fototer.oszk.hu/elso-vilaghaboru/121450/, iterationId: d5701f65-41b2-44d9-b225-1762a0ea5079\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344177}\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344177}, latency: 0\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: d5701f65-41b2-44d9-b225-1762a0ea5079, iterationLatency: 10\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 53a2fd69-aeea-421e-bf69-627af890eabe\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344177}\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344177}, latency: 0\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 53a2fd69-aeea-421e-bf69-627af890eabe\\\",\\\"ts\\\":1710091344177,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 13\\\",\\\"ts\\\":1710091344190,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344191,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344191,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fourcreeds.com/3-benefits-of-utilizing-glass-corner-shelves/, iterationId: 53a2fd69-aeea-421e-bf69-627af890eabe\\\",\\\"ts\\\":1710091344191,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fourcreeds.com/3-benefits-of-utilizing-glass-corner-shelves/, iterationId: 53a2fd69-aeea-421e-bf69-627af890eabe\\\",\\\"ts\\\":1710091344191,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344191}\\\",\\\"ts\\\":1710091344191,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344191}, latency: 0\\\",\\\"ts\\\":1710091344191,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fourcreeds.com/3-benefits-of-utilizing-glass-corner-shelves/, iterationId: 53a2fd69-aeea-421e-bf69-627af890eabe\\\",\\\"ts\\\":1710091344191,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fourcreeds.com/3-benefits-of-utilizing-glass-corner-shelves/, iterationId: 53a2fd69-aeea-421e-bf69-627af890eabe\\\",\\\"ts\\\":1710091344191,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344191,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fourcreeds.com/3-benefits-of-utilizing-glass-corner-shelves/, iterationId: 53a2fd69-aeea-421e-bf69-627af890eabe\\\",\\\"ts\\\":1710091344191,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 179, recordSize: 3020, indexRecordBytes: 429079\\\",\\\"ts\\\":1710091344191,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fourcreeds.com/3-benefits-of-utilizing-glass-corner-shelves/, indexRecordsCount: 180, indexRecordsBytes: 432099, numRecordsNotCheckpointed: 180, iterationId: 53a2fd69-aeea-421e-bf69-627af890eabe\\\",\\\"ts\\\":1710091344191,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fourcreeds.com/3-benefits-of-utilizing-glass-corner-shelves/, iterationId: 53a2fd69-aeea-421e-bf69-627af890eabe\\\",\\\"ts\\\":1710091344191,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344191}\\\",\\\"ts\\\":1710091344191,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344191}, latency: 0\\\",\\\"ts\\\":1710091344191,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 53a2fd69-aeea-421e-bf69-627af890eabe, iterationLatency: 15\\\",\\\"ts\\\":1710091344192,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: ffb8bde3-f442-4cae-971f-1cf03ea48d2f\\\",\\\"ts\\\":1710091344192,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344192}\\\",\\\"ts\\\":1710091344192,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344192}, latency: 0\\\",\\\"ts\\\":1710091344192,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: ffb8bde3-f442-4cae-971f-1cf03ea48d2f\\\",\\\"ts\\\":1710091344192,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091344203,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344203,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344203,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://foureverlane.com/collections/subtle-drama, iterationId: ffb8bde3-f442-4cae-971f-1cf03ea48d2f\\\",\\\"ts\\\":1710091344203,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344203,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://foureverlane.com/collections/subtle-drama, iterationId: ffb8bde3-f442-4cae-971f-1cf03ea48d2f\\\",\\\"ts\\\":1710091344203,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344203}\\\",\\\"ts\\\":1710091344203,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344203}, latency: 0\\\",\\\"ts\\\":1710091344203,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://foureverlane.com/collections/subtle-drama, iterationId: ffb8bde3-f442-4cae-971f-1cf03ea48d2f\\\",\\\"ts\\\":1710091344203,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://foureverlane.com/collections/subtle-drama, iterationId: ffb8bde3-f442-4cae-971f-1cf03ea48d2f\\\",\\\"ts\\\":1710091344203,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://foureverlane.com/collections/subtle-drama, iterationId: ffb8bde3-f442-4cae-971f-1cf03ea48d2f\\\",\\\"ts\\\":1710091344204,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 180, recordSize: 2673, indexRecordBytes: 432099\\\",\\\"ts\\\":1710091344204,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://foureverlane.com/collections/subtle-drama, indexRecordsCount: 181, indexRecordsBytes: 434772, numRecordsNotCheckpointed: 181, iterationId: ffb8bde3-f442-4cae-971f-1cf03ea48d2f\\\",\\\"ts\\\":1710091344204,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://foureverlane.com/collections/subtle-drama, iterationId: ffb8bde3-f442-4cae-971f-1cf03ea48d2f\\\",\\\"ts\\\":1710091344204,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344204}\\\",\\\"ts\\\":1710091344204,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344204}, latency: 0\\\",\\\"ts\\\":1710091344204,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: ffb8bde3-f442-4cae-971f-1cf03ea48d2f, iterationLatency: 12\\\",\\\"ts\\\":1710091344204,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: f96c7794-7fea-40db-af56-92f739936965\\\",\\\"ts\\\":1710091344204,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344204}\\\",\\\"ts\\\":1710091344204,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344204}, latency: 0\\\",\\\"ts\\\":1710091344204,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: f96c7794-7fea-40db-af56-92f739936965\\\",\\\"ts\\\":1710091344204,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344215,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344215,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344215,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fourflowersapothecary.com/products/milky-way, iterationId: f96c7794-7fea-40db-af56-92f739936965\\\",\\\"ts\\\":1710091344215,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fourflowersapothecary.com/products/milky-way, iterationId: f96c7794-7fea-40db-af56-92f739936965\\\",\\\"ts\\\":1710091344215,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344215,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344215}\\\",\\\"ts\\\":1710091344215,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344215}, latency: 0\\\",\\\"ts\\\":1710091344215,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fourflowersapothecary.com/products/milky-way, iterationId: f96c7794-7fea-40db-af56-92f739936965\\\",\\\"ts\\\":1710091344215,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fourflowersapothecary.com/products/milky-way, iterationId: f96c7794-7fea-40db-af56-92f739936965\\\",\\\"ts\\\":1710091344216,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fourflowersapothecary.com/products/milky-way, iterationId: f96c7794-7fea-40db-af56-92f739936965\\\",\\\"ts\\\":1710091344216,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 181, recordSize: 1931, indexRecordBytes: 434772\\\",\\\"ts\\\":1710091344216,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fourflowersapothecary.com/products/milky-way, indexRecordsCount: 182, indexRecordsBytes: 436703, numRecordsNotCheckpointed: 182, iterationId: f96c7794-7fea-40db-af56-92f739936965\\\",\\\"ts\\\":1710091344216,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fourflowersapothecary.com/products/milky-way, iterationId: f96c7794-7fea-40db-af56-92f739936965\\\",\\\"ts\\\":1710091344216,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344216}\\\",\\\"ts\\\":1710091344216,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344216}, latency: 0\\\",\\\"ts\\\":1710091344216,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: f96c7794-7fea-40db-af56-92f739936965, iterationLatency: 12\\\",\\\"ts\\\":1710091344216,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 11c9ffe7-270e-4118-ae6c-4b09189bee89\\\",\\\"ts\\\":1710091344216,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344216}\\\",\\\"ts\\\":1710091344216,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344216}, latency: 0\\\",\\\"ts\\\":1710091344216,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 11c9ffe7-270e-4118-ae6c-4b09189bee89\\\",\\\"ts\\\":1710091344216,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344227,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344227,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344227,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fourlegsorwings.com/collections/vendors?q\\\\u003dFour%20Legs%20or%20Wings, iterationId: 11c9ffe7-270e-4118-ae6c-4b09189bee89\\\",\\\"ts\\\":1710091344227,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fourlegsorwings.com/collections/vendors?q\\\\u003dFour%20Legs%20or%20Wings, iterationId: 11c9ffe7-270e-4118-ae6c-4b09189bee89\\\",\\\"ts\\\":1710091344227,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344227,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344227}\\\",\\\"ts\\\":1710091344227,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344227}, latency: 0\\\",\\\"ts\\\":1710091344228,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fourlegsorwings.com/collections/vendors?q\\\\u003dFour%20Legs%20or%20Wings, iterationId: 11c9ffe7-270e-4118-ae6c-4b09189bee89\\\",\\\"ts\\\":1710091344228,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fourlegsorwings.com/collections/vendors?q\\\\u003dFour%20Legs%20or%20Wings, iterationId: 11c9ffe7-270e-4118-ae6c-4b09189bee89\\\",\\\"ts\\\":1710091344228,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fourlegsorwings.com/collections/vendors?q\\\\u003dFour%20Legs%20or%20Wings, iterationId: 11c9ffe7-270e-4118-ae6c-4b09189bee89\\\",\\\"ts\\\":1710091344228,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 182, recordSize: 1047, indexRecordBytes: 436703\\\",\\\"ts\\\":1710091344228,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fourlegsorwings.com/collections/vendors?q\\\\u003dFour%20Legs%20or%20Wings, indexRecordsCount: 183, indexRecordsBytes: 437750, numRecordsNotCheckpointed: 183, iterationId: 11c9ffe7-270e-4118-ae6c-4b09189bee89\\\",\\\"ts\\\":1710091344228,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fourlegsorwings.com/collections/vendors?q\\\\u003dFour%20Legs%20or%20Wings, iterationId: 11c9ffe7-270e-4118-ae6c-4b09189bee89\\\",\\\"ts\\\":1710091344228,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344228}\\\",\\\"ts\\\":1710091344228,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344228}, latency: 0\\\",\\\"ts\\\":1710091344228,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 11c9ffe7-270e-4118-ae6c-4b09189bee89, iterationLatency: 12\\\",\\\"ts\\\":1710091344228,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 45162b18-15f5-4bd4-a1a1-808dd36b7330\\\",\\\"ts\\\":1710091344228,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344228}\\\",\\\"ts\\\":1710091344228,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344228}, latency: 0\\\",\\\"ts\\\":1710091344228,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 45162b18-15f5-4bd4-a1a1-808dd36b7330\\\",\\\"ts\\\":1710091344228,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 13\\\",\\\"ts\\\":1710091344240,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344240,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344240,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://foursquare.com/danielm6165419, iterationId: 45162b18-15f5-4bd4-a1a1-808dd36b7330\\\",\\\"ts\\\":1710091344240,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344240,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://foursquare.com/danielm6165419, iterationId: 45162b18-15f5-4bd4-a1a1-808dd36b7330\\\",\\\"ts\\\":1710091344240,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344241}\\\",\\\"ts\\\":1710091344241,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344241}, latency: 0\\\",\\\"ts\\\":1710091344241,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://foursquare.com/danielm6165419, iterationId: 45162b18-15f5-4bd4-a1a1-808dd36b7330\\\",\\\"ts\\\":1710091344241,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://foursquare.com/danielm6165419, iterationId: 45162b18-15f5-4bd4-a1a1-808dd36b7330\\\",\\\"ts\\\":1710091344241,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://foursquare.com/danielm6165419, iterationId: 45162b18-15f5-4bd4-a1a1-808dd36b7330\\\",\\\"ts\\\":1710091344241,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 183, recordSize: 1832, indexRecordBytes: 437750\\\",\\\"ts\\\":1710091344241,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://foursquare.com/danielm6165419, indexRecordsCount: 184, indexRecordsBytes: 439582, numRecordsNotCheckpointed: 184, iterationId: 45162b18-15f5-4bd4-a1a1-808dd36b7330\\\",\\\"ts\\\":1710091344241,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://foursquare.com/danielm6165419, iterationId: 45162b18-15f5-4bd4-a1a1-808dd36b7330\\\",\\\"ts\\\":1710091344241,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344241}\\\",\\\"ts\\\":1710091344241,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344241}, latency: 0\\\",\\\"ts\\\":1710091344241,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 45162b18-15f5-4bd4-a1a1-808dd36b7330, iterationLatency: 13\\\",\\\"ts\\\":1710091344241,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: d4eddb53-7dec-4b69-8240-f091cb752968\\\",\\\"ts\\\":1710091344241,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344241}\\\",\\\"ts\\\":1710091344241,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344241}, latency: 0\\\",\\\"ts\\\":1710091344241,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: d4eddb53-7dec-4b69-8240-f091cb752968\\\",\\\"ts\\\":1710091344241,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344252,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344252,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://foussier.net/2010/07/06/trophee-de-50-ans-a-bauge/, iterationId: d4eddb53-7dec-4b69-8240-f091cb752968\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://foussier.net/2010/07/06/trophee-de-50-ans-a-bauge/, iterationId: d4eddb53-7dec-4b69-8240-f091cb752968\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344253}\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344253}, latency: 0\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://foussier.net/2010/07/06/trophee-de-50-ans-a-bauge/, iterationId: d4eddb53-7dec-4b69-8240-f091cb752968\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://foussier.net/2010/07/06/trophee-de-50-ans-a-bauge/, iterationId: d4eddb53-7dec-4b69-8240-f091cb752968\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://foussier.net/2010/07/06/trophee-de-50-ans-a-bauge/, iterationId: d4eddb53-7dec-4b69-8240-f091cb752968\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 184, recordSize: 1370, indexRecordBytes: 439582\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://foussier.net/2010/07/06/trophee-de-50-ans-a-bauge/, indexRecordsCount: 185, indexRecordsBytes: 440952, numRecordsNotCheckpointed: 185, iterationId: d4eddb53-7dec-4b69-8240-f091cb752968\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://foussier.net/2010/07/06/trophee-de-50-ans-a-bauge/, iterationId: d4eddb53-7dec-4b69-8240-f091cb752968\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344253}\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344253}, latency: 0\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: d4eddb53-7dec-4b69-8240-f091cb752968, iterationLatency: 12\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 147278cf-fae0-4495-8025-4dc221a33c25\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344253}\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344253}, latency: 0\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 147278cf-fae0-4495-8025-4dc221a33c25\\\",\\\"ts\\\":1710091344253,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344265,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fox40.com/business/press-releases/accesswire/807604/shareholder-alert-potential-recovery-for-barclays-plc-bcs-investors-affected-by-stock-drop-levi-korsinsky-pursuing-class-action-lawsuit/, iterationId: 147278cf-fae0-4495-8025-4dc221a33c25\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fox40.com/business/press-releases/accesswire/807604/shareholder-alert-potential-recovery-for-barclays-plc-bcs-investors-affected-by-stock-drop-levi-korsinsky-pursuing-class-action-lawsuit/, iterationId: 147278cf-fae0-4495-8025-4dc221a33c25\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344266}\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344266}, latency: 0\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fox40.com/business/press-releases/accesswire/807604/shareholder-alert-potential-recovery-for-barclays-plc-bcs-investors-affected-by-stock-drop-levi-korsinsky-pursuing-class-action-lawsuit/, iterationId: 147278cf-fae0-4495-8025-4dc221a33c25\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fox40.com/business/press-releases/accesswire/807604/shareholder-alert-potential-recovery-for-barclays-plc-bcs-investors-affected-by-stock-drop-levi-korsinsky-pursuing-class-action-lawsuit/, iterationId: 147278cf-fae0-4495-8025-4dc221a33c25\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fox40.com/business/press-releases/accesswire/807604/shareholder-alert-potential-recovery-for-barclays-plc-bcs-investors-affected-by-stock-drop-levi-korsinsky-pursuing-class-action-lawsuit/, iterationId: 147278cf-fae0-4495-8025-4dc221a33c25\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 185, recordSize: 3422, indexRecordBytes: 440952\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fox40.com/business/press-releases/accesswire/807604/shareholder-alert-potential-recovery-for-barclays-plc-bcs-investors-affected-by-stock-drop-levi-korsinsky-pursuing-class-action-lawsuit/, indexRecordsCount: 186, indexRecordsBytes: 444374, numRecordsNotCheckpointed: 186, iterationId: 147278cf-fae0-4495-8025-4dc221a33c25\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fox40.com/business/press-releases/accesswire/807604/shareholder-alert-potential-recovery-for-barclays-plc-bcs-investors-affected-by-stock-drop-levi-korsinsky-pursuing-class-action-lawsuit/, iterationId: 147278cf-fae0-4495-8025-4dc221a33c25\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344266}\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344266}, latency: 0\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 147278cf-fae0-4495-8025-4dc221a33c25, iterationLatency: 13\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: ba020b9e-de16-4acb-b679-2b60aac38467\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344266}\\\",\\\"ts\\\":1710091344266,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344266}, latency: 0\\\",\\\"ts\\\":1710091344267,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: ba020b9e-de16-4acb-b679-2b60aac38467\\\",\\\"ts\\\":1710091344267,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 13\\\",\\\"ts\\\":1710091344279,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344279,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344279,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://foxandwit.com/blogs/news/fox-wit-weekly-book-recommendations-books-with-ace-and-aroace-rep, iterationId: ba020b9e-de16-4acb-b679-2b60aac38467\\\",\\\"ts\\\":1710091344279,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344279,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://foxandwit.com/blogs/news/fox-wit-weekly-book-recommendations-books-with-ace-and-aroace-rep, iterationId: ba020b9e-de16-4acb-b679-2b60aac38467\\\",\\\"ts\\\":1710091344279,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344280}\\\",\\\"ts\\\":1710091344280,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344280}, latency: 0\\\",\\\"ts\\\":1710091344280,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://foxandwit.com/blogs/news/fox-wit-weekly-book-recommendations-books-with-ace-and-aroace-rep, iterationId: ba020b9e-de16-4acb-b679-2b60aac38467\\\",\\\"ts\\\":1710091344280,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://foxandwit.com/blogs/news/fox-wit-weekly-book-recommendations-books-with-ace-and-aroace-rep, iterationId: ba020b9e-de16-4acb-b679-2b60aac38467\\\",\\\"ts\\\":1710091344280,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://foxandwit.com/blogs/news/fox-wit-weekly-book-recommendations-books-with-ace-and-aroace-rep, iterationId: ba020b9e-de16-4acb-b679-2b60aac38467\\\",\\\"ts\\\":1710091344280,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 186, recordSize: 2709, indexRecordBytes: 444374\\\",\\\"ts\\\":1710091344280,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://foxandwit.com/blogs/news/fox-wit-weekly-book-recommendations-books-with-ace-and-aroace-rep, indexRecordsCount: 187, indexRecordsBytes: 447083, numRecordsNotCheckpointed: 187, iterationId: ba020b9e-de16-4acb-b679-2b60aac38467\\\",\\\"ts\\\":1710091344280,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://foxandwit.com/blogs/news/fox-wit-weekly-book-recommendations-books-with-ace-and-aroace-rep, iterationId: ba020b9e-de16-4acb-b679-2b60aac38467\\\",\\\"ts\\\":1710091344280,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344280}\\\",\\\"ts\\\":1710091344280,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344280}, latency: 0\\\",\\\"ts\\\":1710091344280,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: ba020b9e-de16-4acb-b679-2b60aac38467, iterationLatency: 14\\\",\\\"ts\\\":1710091344280,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: adc45924-5ee4-419b-bb2a-012f161b1e06\\\",\\\"ts\\\":1710091344280,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344280}\\\",\\\"ts\\\":1710091344280,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344280}, latency: 0\\\",\\\"ts\\\":1710091344280,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: adc45924-5ee4-419b-bb2a-012f161b1e06\\\",\\\"ts\\\":1710091344280,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344291,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344291,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344291,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://foxvape.shop/brands/SvoioMesto, iterationId: adc45924-5ee4-419b-bb2a-012f161b1e06\\\",\\\"ts\\\":1710091344291,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://foxvape.shop/brands/SvoioMesto, iterationId: adc45924-5ee4-419b-bb2a-012f161b1e06\\\",\\\"ts\\\":1710091344291,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344291}\\\",\\\"ts\\\":1710091344291,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344291}, latency: 0\\\",\\\"ts\\\":1710091344291,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://foxvape.shop/brands/SvoioMesto, iterationId: adc45924-5ee4-419b-bb2a-012f161b1e06\\\",\\\"ts\\\":1710091344291,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://foxvape.shop/brands/SvoioMesto, iterationId: adc45924-5ee4-419b-bb2a-012f161b1e06\\\",\\\"ts\\\":1710091344291,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344291,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://foxvape.shop/brands/SvoioMesto, iterationId: adc45924-5ee4-419b-bb2a-012f161b1e06\\\",\\\"ts\\\":1710091344291,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 187, recordSize: 1499, indexRecordBytes: 447083\\\",\\\"ts\\\":1710091344291,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://foxvape.shop/brands/SvoioMesto, indexRecordsCount: 188, indexRecordsBytes: 448582, numRecordsNotCheckpointed: 188, iterationId: adc45924-5ee4-419b-bb2a-012f161b1e06\\\",\\\"ts\\\":1710091344292,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://foxvape.shop/brands/SvoioMesto, iterationId: adc45924-5ee4-419b-bb2a-012f161b1e06\\\",\\\"ts\\\":1710091344292,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344292}\\\",\\\"ts\\\":1710091344292,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344292}, latency: 0\\\",\\\"ts\\\":1710091344292,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: adc45924-5ee4-419b-bb2a-012f161b1e06, iterationLatency: 12\\\",\\\"ts\\\":1710091344292,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 0bd12ba5-4a83-428e-82a0-54208477b430\\\",\\\"ts\\\":1710091344292,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344292}\\\",\\\"ts\\\":1710091344292,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344292}, latency: 0\\\",\\\"ts\\\":1710091344292,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 0bd12ba5-4a83-428e-82a0-54208477b430\\\",\\\"ts\\\":1710091344292,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 13\\\",\\\"ts\\\":1710091344305,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344305,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344305,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://foxy-print.com.ua/podushki, iterationId: 0bd12ba5-4a83-428e-82a0-54208477b430\\\",\\\"ts\\\":1710091344305,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://foxy-print.com.ua/podushki, iterationId: 0bd12ba5-4a83-428e-82a0-54208477b430\\\",\\\"ts\\\":1710091344305,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344305}\\\",\\\"ts\\\":1710091344305,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344305,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344305}, latency: 0\\\",\\\"ts\\\":1710091344305,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://foxy-print.com.ua/podushki, iterationId: 0bd12ba5-4a83-428e-82a0-54208477b430\\\",\\\"ts\\\":1710091344305,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://foxy-print.com.ua/podushki, iterationId: 0bd12ba5-4a83-428e-82a0-54208477b430\\\",\\\"ts\\\":1710091344305,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://foxy-print.com.ua/podushki, iterationId: 0bd12ba5-4a83-428e-82a0-54208477b430\\\",\\\"ts\\\":1710091344306,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 188, recordSize: 3238, indexRecordBytes: 448582\\\",\\\"ts\\\":1710091344306,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://foxy-print.com.ua/podushki, indexRecordsCount: 189, indexRecordsBytes: 451820, numRecordsNotCheckpointed: 189, iterationId: 0bd12ba5-4a83-428e-82a0-54208477b430\\\",\\\"ts\\\":1710091344306,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://foxy-print.com.ua/podushki, iterationId: 0bd12ba5-4a83-428e-82a0-54208477b430\\\",\\\"ts\\\":1710091344306,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344306}\\\",\\\"ts\\\":1710091344306,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344306}, latency: 0\\\",\\\"ts\\\":1710091344306,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 0bd12ba5-4a83-428e-82a0-54208477b430, iterationLatency: 14\\\",\\\"ts\\\":1710091344306,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: be7934f2-13c2-4afb-97c6-07cc44ec4a73\\\",\\\"ts\\\":1710091344306,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344306}\\\",\\\"ts\\\":1710091344306,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344306}, latency: 0\\\",\\\"ts\\\":1710091344306,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: be7934f2-13c2-4afb-97c6-07cc44ec4a73\\\",\\\"ts\\\":1710091344306,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 13\\\",\\\"ts\\\":1710091344318,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344318,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344318,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fp.office-aizawa.com/2023/10/26/%E6%89%8B%E4%BB%98%E9%87%91%E3%82%92%E6%89%95%E3%81%A3%E3%81%9F%E5%88%86%E3%81%A0%E3%81%91%E5%80%9F%E5%85%A5%E9%A1%8D%E3%81%AF%E6%B8%9B%E3%81%A3%E3%81%A6%E3%81%97%E3%81%BE%E3%81%86%E3%81%AE%E3%81%8B/, iterationId: be7934f2-13c2-4afb-97c6-07cc44ec4a73\\\",\\\"ts\\\":1710091344318,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fp.office-aizawa.com/2023/10/26/%E6%89%8B%E4%BB%98%E9%87%91%E3%82%92%E6%89%95%E3%81%A3%E3%81%9F%E5%88%86%E3%81%A0%E3%81%91%E5%80%9F%E5%85%A5%E9%A1%8D%E3%81%AF%E6%B8%9B%E3%81%A3%E3%81%A6%E3%81%97%E3%81%BE%E3%81%86%E3%81%AE%E3%81%8B/, iterationId: be7934f2-13c2-4afb-97c6-07cc44ec4a73\\\",\\\"ts\\\":1710091344318,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344318}\\\",\\\"ts\\\":1710091344318,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344318,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344318}, latency: 0\\\",\\\"ts\\\":1710091344318,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fp.office-aizawa.com/2023/10/26/%E6%89%8B%E4%BB%98%E9%87%91%E3%82%92%E6%89%95%E3%81%A3%E3%81%9F%E5%88%86%E3%81%A0%E3%81%91%E5%80%9F%E5%85%A5%E9%A1%8D%E3%81%AF%E6%B8%9B%E3%81%A3%E3%81%A6%E3%81%97%E3%81%BE%E3%81%86%E3%81%AE%E3%81%8B/, iterationId: be7934f2-13c2-4afb-97c6-07cc44ec4a73\\\",\\\"ts\\\":1710091344318,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fp.office-aizawa.com/2023/10/26/%E6%89%8B%E4%BB%98%E9%87%91%E3%82%92%E6%89%95%E3%81%A3%E3%81%9F%E5%88%86%E3%81%A0%E3%81%91%E5%80%9F%E5%85%A5%E9%A1%8D%E3%81%AF%E6%B8%9B%E3%81%A3%E3%81%A6%E3%81%97%E3%81%BE%E3%81%86%E3%81%AE%E3%81%8B/, iterationId: be7934f2-13c2-4afb-97c6-07cc44ec4a73\\\",\\\"ts\\\":1710091344318,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fp.office-aizawa.com/2023/10/26/%E6%89%8B%E4%BB%98%E9%87%91%E3%82%92%E6%89%95%E3%81%A3%E3%81%9F%E5%88%86%E3%81%A0%E3%81%91%E5%80%9F%E5%85%A5%E9%A1%8D%E3%81%AF%E6%B8%9B%E3%81%A3%E3%81%A6%E3%81%97%E3%81%BE%E3%81%86%E3%81%AE%E3%81%8B/, iterationId: be7934f2-13c2-4afb-97c6-07cc44ec4a73\\\",\\\"ts\\\":1710091344319,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 189, recordSize: 2533, indexRecordBytes: 451820\\\",\\\"ts\\\":1710091344319,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fp.office-aizawa.com/2023/10/26/%E6%89%8B%E4%BB%98%E9%87%91%E3%82%92%E6%89%95%E3%81%A3%E3%81%9F%E5%88%86%E3%81%A0%E3%81%91%E5%80%9F%E5%85%A5%E9%A1%8D%E3%81%AF%E6%B8%9B%E3%81%A3%E3%81%A6%E3%81%97%E3%81%BE%E3%81%86%E3%81%AE%E3%81%8B/, indexRecordsCount: 190, indexRecordsBytes: 454353, numRecordsNotCheckpointed: 190, iterationId: be7934f2-13c2-4afb-97c6-07cc44ec4a73\\\",\\\"ts\\\":1710091344319,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fp.office-aizawa.com/2023/10/26/%E6%89%8B%E4%BB%98%E9%87%91%E3%82%92%E6%89%95%E3%81%A3%E3%81%9F%E5%88%86%E3%81%A0%E3%81%91%E5%80%9F%E5%85%A5%E9%A1%8D%E3%81%AF%E6%B8%9B%E3%81%A3%E3%81%A6%E3%81%97%E3%81%BE%E3%81%86%E3%81%AE%E3%81%8B/, iterationId: be7934f2-13c2-4afb-97c6-07cc44ec4a73\\\",\\\"ts\\\":1710091344319,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344319}\\\",\\\"ts\\\":1710091344319,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344319}, latency: 0\\\",\\\"ts\\\":1710091344319,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: be7934f2-13c2-4afb-97c6-07cc44ec4a73, iterationLatency: 13\\\",\\\"ts\\\":1710091344319,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: ceb318bd-8a7a-45e5-90a3-d115c3ab1e6f\\\",\\\"ts\\\":1710091344319,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344319}\\\",\\\"ts\\\":1710091344319,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344319}, latency: 0\\\",\\\"ts\\\":1710091344319,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: ceb318bd-8a7a-45e5-90a3-d115c3ab1e6f\\\",\\\"ts\\\":1710091344319,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344330,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fpalzira.es/web/index.php/ca-es/noticies/2-uncategorised/780-video-centre-oferta-formativa, iterationId: ceb318bd-8a7a-45e5-90a3-d115c3ab1e6f\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fpalzira.es/web/index.php/ca-es/noticies/2-uncategorised/780-video-centre-oferta-formativa, iterationId: ceb318bd-8a7a-45e5-90a3-d115c3ab1e6f\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344331}\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344331}, latency: 0\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fpalzira.es/web/index.php/ca-es/noticies/2-uncategorised/780-video-centre-oferta-formativa, iterationId: ceb318bd-8a7a-45e5-90a3-d115c3ab1e6f\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fpalzira.es/web/index.php/ca-es/noticies/2-uncategorised/780-video-centre-oferta-formativa, iterationId: ceb318bd-8a7a-45e5-90a3-d115c3ab1e6f\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fpalzira.es/web/index.php/ca-es/noticies/2-uncategorised/780-video-centre-oferta-formativa, iterationId: ceb318bd-8a7a-45e5-90a3-d115c3ab1e6f\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 190, recordSize: 2101, indexRecordBytes: 454353\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fpalzira.es/web/index.php/ca-es/noticies/2-uncategorised/780-video-centre-oferta-formativa, indexRecordsCount: 191, indexRecordsBytes: 456454, numRecordsNotCheckpointed: 191, iterationId: ceb318bd-8a7a-45e5-90a3-d115c3ab1e6f\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fpalzira.es/web/index.php/ca-es/noticies/2-uncategorised/780-video-centre-oferta-formativa, iterationId: ceb318bd-8a7a-45e5-90a3-d115c3ab1e6f\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344331}\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344331}, latency: 0\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: ceb318bd-8a7a-45e5-90a3-d115c3ab1e6f, iterationLatency: 12\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: c2e0a9da-319b-431c-9415-f760d1b22f64\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344331}\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344331}, latency: 0\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: c2e0a9da-319b-431c-9415-f760d1b22f64\\\",\\\"ts\\\":1710091344331,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 15\\\",\\\"ts\\\":1710091344346,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344346,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344346,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fpbaseballoutsider.blogspot.com/2010/04/wins-are-wins-but.html, iterationId: c2e0a9da-319b-431c-9415-f760d1b22f64\\\",\\\"ts\\\":1710091344346,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fpbaseballoutsider.blogspot.com/2010/04/wins-are-wins-but.html, iterationId: c2e0a9da-319b-431c-9415-f760d1b22f64\\\",\\\"ts\\\":1710091344346,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344346,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344346}\\\",\\\"ts\\\":1710091344346,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344346}, latency: 0\\\",\\\"ts\\\":1710091344346,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fpbaseballoutsider.blogspot.com/2010/04/wins-are-wins-but.html, iterationId: c2e0a9da-319b-431c-9415-f760d1b22f64\\\",\\\"ts\\\":1710091344346,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fpbaseballoutsider.blogspot.com/2010/04/wins-are-wins-but.html, iterationId: c2e0a9da-319b-431c-9415-f760d1b22f64\\\",\\\"ts\\\":1710091344346,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fpbaseballoutsider.blogspot.com/2010/04/wins-are-wins-but.html, iterationId: c2e0a9da-319b-431c-9415-f760d1b22f64\\\",\\\"ts\\\":1710091344347,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 191, recordSize: 3338, indexRecordBytes: 456454\\\",\\\"ts\\\":1710091344347,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fpbaseballoutsider.blogspot.com/2010/04/wins-are-wins-but.html, indexRecordsCount: 192, indexRecordsBytes: 459792, numRecordsNotCheckpointed: 192, iterationId: c2e0a9da-319b-431c-9415-f760d1b22f64\\\",\\\"ts\\\":1710091344347,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fpbaseballoutsider.blogspot.com/2010/04/wins-are-wins-but.html, iterationId: c2e0a9da-319b-431c-9415-f760d1b22f64\\\",\\\"ts\\\":1710091344347,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344347}\\\",\\\"ts\\\":1710091344347,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344347}, latency: 0\\\",\\\"ts\\\":1710091344347,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: c2e0a9da-319b-431c-9415-f760d1b22f64, iterationLatency: 16\\\",\\\"ts\\\":1710091344347,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: da60ae2e-3744-4079-9296-0278e6d18975\\\",\\\"ts\\\":1710091344347,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344347}\\\",\\\"ts\\\":1710091344347,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344347}, latency: 0\\\",\\\"ts\\\":1710091344347,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: da60ae2e-3744-4079-9296-0278e6d18975\\\",\\\"ts\\\":1710091344347,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344358,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344358,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344358,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fpbaseballoutsider.blogspot.com/2013/12/twins-cant-catch-veteran-backstop.html, iterationId: da60ae2e-3744-4079-9296-0278e6d18975\\\",\\\"ts\\\":1710091344358,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fpbaseballoutsider.blogspot.com/2013/12/twins-cant-catch-veteran-backstop.html, iterationId: da60ae2e-3744-4079-9296-0278e6d18975\\\",\\\"ts\\\":1710091344358,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344358}\\\",\\\"ts\\\":1710091344358,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344358}, latency: 0\\\",\\\"ts\\\":1710091344358,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fpbaseballoutsider.blogspot.com/2013/12/twins-cant-catch-veteran-backstop.html, iterationId: da60ae2e-3744-4079-9296-0278e6d18975\\\",\\\"ts\\\":1710091344358,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fpbaseballoutsider.blogspot.com/2013/12/twins-cant-catch-veteran-backstop.html, iterationId: da60ae2e-3744-4079-9296-0278e6d18975\\\",\\\"ts\\\":1710091344358,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344358,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fpbaseballoutsider.blogspot.com/2013/12/twins-cant-catch-veteran-backstop.html, iterationId: da60ae2e-3744-4079-9296-0278e6d18975\\\",\\\"ts\\\":1710091344359,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 192, recordSize: 2742, indexRecordBytes: 459792\\\",\\\"ts\\\":1710091344359,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fpbaseballoutsider.blogspot.com/2013/12/twins-cant-catch-veteran-backstop.html, indexRecordsCount: 193, indexRecordsBytes: 462534, numRecordsNotCheckpointed: 193, iterationId: da60ae2e-3744-4079-9296-0278e6d18975\\\",\\\"ts\\\":1710091344359,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fpbaseballoutsider.blogspot.com/2013/12/twins-cant-catch-veteran-backstop.html, iterationId: da60ae2e-3744-4079-9296-0278e6d18975\\\",\\\"ts\\\":1710091344359,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344359}\\\",\\\"ts\\\":1710091344359,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344359}, latency: 0\\\",\\\"ts\\\":1710091344359,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: da60ae2e-3744-4079-9296-0278e6d18975, iterationLatency: 12\\\",\\\"ts\\\":1710091344359,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 113641c6-220a-4319-8e48-d424cb3f290c\\\",\\\"ts\\\":1710091344359,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344359}\\\",\\\"ts\\\":1710091344359,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344359}, latency: 0\\\",\\\"ts\\\":1710091344359,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 113641c6-220a-4319-8e48-d424cb3f290c\\\",\\\"ts\\\":1710091344359,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 15\\\",\\\"ts\\\":1710091344373,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fpdsouthflorida.org/united-states-v-pate-no-20-10545-oct-11-2023/, iterationId: 113641c6-220a-4319-8e48-d424cb3f290c\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fpdsouthflorida.org/united-states-v-pate-no-20-10545-oct-11-2023/, iterationId: 113641c6-220a-4319-8e48-d424cb3f290c\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344374}\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344374}, latency: 0\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fpdsouthflorida.org/united-states-v-pate-no-20-10545-oct-11-2023/, iterationId: 113641c6-220a-4319-8e48-d424cb3f290c\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fpdsouthflorida.org/united-states-v-pate-no-20-10545-oct-11-2023/, iterationId: 113641c6-220a-4319-8e48-d424cb3f290c\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fpdsouthflorida.org/united-states-v-pate-no-20-10545-oct-11-2023/, iterationId: 113641c6-220a-4319-8e48-d424cb3f290c\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 193, recordSize: 1940, indexRecordBytes: 462534\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fpdsouthflorida.org/united-states-v-pate-no-20-10545-oct-11-2023/, indexRecordsCount: 194, indexRecordsBytes: 464474, numRecordsNotCheckpointed: 194, iterationId: 113641c6-220a-4319-8e48-d424cb3f290c\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fpdsouthflorida.org/united-states-v-pate-no-20-10545-oct-11-2023/, iterationId: 113641c6-220a-4319-8e48-d424cb3f290c\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344374}\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344374}, latency: 0\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 113641c6-220a-4319-8e48-d424cb3f290c, iterationLatency: 15\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: e5b72204-7860-4279-bbe5-0b7b93db9c7e\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344374}\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344374}, latency: 0\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: e5b72204-7860-4279-bbe5-0b7b93db9c7e\\\",\\\"ts\\\":1710091344374,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 15\\\",\\\"ts\\\":1710091344389,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344389,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344389,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fppk.org/about/cult_centre/activity/15973/, iterationId: e5b72204-7860-4279-bbe5-0b7b93db9c7e\\\",\\\"ts\\\":1710091344389,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fppk.org/about/cult_centre/activity/15973/, iterationId: e5b72204-7860-4279-bbe5-0b7b93db9c7e\\\",\\\"ts\\\":1710091344389,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344389}\\\",\\\"ts\\\":1710091344389,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344389}, latency: 0\\\",\\\"ts\\\":1710091344390,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fppk.org/about/cult_centre/activity/15973/, iterationId: e5b72204-7860-4279-bbe5-0b7b93db9c7e\\\",\\\"ts\\\":1710091344390,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fppk.org/about/cult_centre/activity/15973/, iterationId: e5b72204-7860-4279-bbe5-0b7b93db9c7e\\\",\\\"ts\\\":1710091344390,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344390,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fppk.org/about/cult_centre/activity/15973/, iterationId: e5b72204-7860-4279-bbe5-0b7b93db9c7e\\\",\\\"ts\\\":1710091344391,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 194, recordSize: 5022, indexRecordBytes: 464474\\\",\\\"ts\\\":1710091344391,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fppk.org/about/cult_centre/activity/15973/, indexRecordsCount: 195, indexRecordsBytes: 469496, numRecordsNotCheckpointed: 195, iterationId: e5b72204-7860-4279-bbe5-0b7b93db9c7e\\\",\\\"ts\\\":1710091344391,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fppk.org/about/cult_centre/activity/15973/, iterationId: e5b72204-7860-4279-bbe5-0b7b93db9c7e\\\",\\\"ts\\\":1710091344391,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344391}\\\",\\\"ts\\\":1710091344391,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344391}, latency: 0\\\",\\\"ts\\\":1710091344391,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: e5b72204-7860-4279-bbe5-0b7b93db9c7e, iterationLatency: 17\\\",\\\"ts\\\":1710091344391,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 7151cbd5-7d1f-4cde-a602-f6175fc9c1ff\\\",\\\"ts\\\":1710091344391,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344391}\\\",\\\"ts\\\":1710091344391,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344391}, latency: 0\\\",\\\"ts\\\":1710091344391,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 7151cbd5-7d1f-4cde-a602-f6175fc9c1ff\\\",\\\"ts\\\":1710091344391,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 14\\\",\\\"ts\\\":1710091344404,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344404,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344404,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fppk.org/news/monitoring/13061/, iterationId: 7151cbd5-7d1f-4cde-a602-f6175fc9c1ff\\\",\\\"ts\\\":1710091344404,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fppk.org/news/monitoring/13061/, iterationId: 7151cbd5-7d1f-4cde-a602-f6175fc9c1ff\\\",\\\"ts\\\":1710091344405,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344405}\\\",\\\"ts\\\":1710091344405,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344405}, latency: 0\\\",\\\"ts\\\":1710091344405,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fppk.org/news/monitoring/13061/, iterationId: 7151cbd5-7d1f-4cde-a602-f6175fc9c1ff\\\",\\\"ts\\\":1710091344405,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fppk.org/news/monitoring/13061/, iterationId: 7151cbd5-7d1f-4cde-a602-f6175fc9c1ff\\\",\\\"ts\\\":1710091344405,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344405,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fppk.org/news/monitoring/13061/, iterationId: 7151cbd5-7d1f-4cde-a602-f6175fc9c1ff\\\",\\\"ts\\\":1710091344405,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 195, recordSize: 3347, indexRecordBytes: 469496\\\",\\\"ts\\\":1710091344405,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fppk.org/news/monitoring/13061/, indexRecordsCount: 196, indexRecordsBytes: 472843, numRecordsNotCheckpointed: 196, iterationId: 7151cbd5-7d1f-4cde-a602-f6175fc9c1ff\\\",\\\"ts\\\":1710091344405,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fppk.org/news/monitoring/13061/, iterationId: 7151cbd5-7d1f-4cde-a602-f6175fc9c1ff\\\",\\\"ts\\\":1710091344405,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344405}\\\",\\\"ts\\\":1710091344405,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344405}, latency: 0\\\",\\\"ts\\\":1710091344406,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 7151cbd5-7d1f-4cde-a602-f6175fc9c1ff, iterationLatency: 15\\\",\\\"ts\\\":1710091344406,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 295eb7c2-7da3-4298-8883-3a8e38f0a790\\\",\\\"ts\\\":1710091344406,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344406}\\\",\\\"ts\\\":1710091344406,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344406}, latency: 0\\\",\\\"ts\\\":1710091344406,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 295eb7c2-7da3-4298-8883-3a8e38f0a790\\\",\\\"ts\\\":1710091344406,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 15\\\",\\\"ts\\\":1710091344420,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344422,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344422,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fpso.ru/information/events/12329/, iterationId: 295eb7c2-7da3-4298-8883-3a8e38f0a790\\\",\\\"ts\\\":1710091344422,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fpso.ru/information/events/12329/, iterationId: 295eb7c2-7da3-4298-8883-3a8e38f0a790\\\",\\\"ts\\\":1710091344422,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344423}\\\",\\\"ts\\\":1710091344423,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344423}, latency: 0\\\",\\\"ts\\\":1710091344423,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fpso.ru/information/events/12329/, iterationId: 295eb7c2-7da3-4298-8883-3a8e38f0a790\\\",\\\"ts\\\":1710091344423,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fpso.ru/information/events/12329/, iterationId: 295eb7c2-7da3-4298-8883-3a8e38f0a790\\\",\\\"ts\\\":1710091344423,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344423,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fpso.ru/information/events/12329/, iterationId: 295eb7c2-7da3-4298-8883-3a8e38f0a790\\\",\\\"ts\\\":1710091344424,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 196, recordSize: 5095, indexRecordBytes: 472843\\\",\\\"ts\\\":1710091344424,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fpso.ru/information/events/12329/, indexRecordsCount: 197, indexRecordsBytes: 477938, numRecordsNotCheckpointed: 197, iterationId: 295eb7c2-7da3-4298-8883-3a8e38f0a790\\\",\\\"ts\\\":1710091344424,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fpso.ru/information/events/12329/, iterationId: 295eb7c2-7da3-4298-8883-3a8e38f0a790\\\",\\\"ts\\\":1710091344424,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344424}\\\",\\\"ts\\\":1710091344424,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344424}, latency: 0\\\",\\\"ts\\\":1710091344424,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 295eb7c2-7da3-4298-8883-3a8e38f0a790, iterationLatency: 18\\\",\\\"ts\\\":1710091344424,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 3166e785-6e01-45fa-96bb-c68cd670ff81\\\",\\\"ts\\\":1710091344424,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344424}\\\",\\\"ts\\\":1710091344424,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344424}, latency: 0\\\",\\\"ts\\\":1710091344424,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 3166e785-6e01-45fa-96bb-c68cd670ff81\\\",\\\"ts\\\":1710091344424,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 16\\\",\\\"ts\\\":1710091344439,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344440,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344440,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fpso.ru/information/events/7376/, iterationId: 3166e785-6e01-45fa-96bb-c68cd670ff81\\\",\\\"ts\\\":1710091344440,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fpso.ru/information/events/7376/, iterationId: 3166e785-6e01-45fa-96bb-c68cd670ff81\\\",\\\"ts\\\":1710091344440,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344440}\\\",\\\"ts\\\":1710091344440,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344440}, latency: 0\\\",\\\"ts\\\":1710091344440,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fpso.ru/information/events/7376/, iterationId: 3166e785-6e01-45fa-96bb-c68cd670ff81\\\",\\\"ts\\\":1710091344440,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fpso.ru/information/events/7376/, iterationId: 3166e785-6e01-45fa-96bb-c68cd670ff81\\\",\\\"ts\\\":1710091344440,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344440,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fpso.ru/information/events/7376/, iterationId: 3166e785-6e01-45fa-96bb-c68cd670ff81\\\",\\\"ts\\\":1710091344441,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 197, recordSize: 5203, indexRecordBytes: 477938\\\",\\\"ts\\\":1710091344441,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fpso.ru/information/events/7376/, indexRecordsCount: 198, indexRecordsBytes: 483141, numRecordsNotCheckpointed: 198, iterationId: 3166e785-6e01-45fa-96bb-c68cd670ff81\\\",\\\"ts\\\":1710091344441,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fpso.ru/information/events/7376/, iterationId: 3166e785-6e01-45fa-96bb-c68cd670ff81\\\",\\\"ts\\\":1710091344441,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344441}\\\",\\\"ts\\\":1710091344441,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344441}, latency: 0\\\",\\\"ts\\\":1710091344441,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 3166e785-6e01-45fa-96bb-c68cd670ff81, iterationLatency: 18\\\",\\\"ts\\\":1710091344442,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: f1dffda7-59e4-4ee6-bee0-02cacd3bd80f\\\",\\\"ts\\\":1710091344442,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344442}\\\",\\\"ts\\\":1710091344442,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344442}, latency: 0\\\",\\\"ts\\\":1710091344442,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: f1dffda7-59e4-4ee6-bee0-02cacd3bd80f\\\",\\\"ts\\\":1710091344442,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 18\\\",\\\"ts\\\":1710091344459,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344459,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344459,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.admiremyskin.com/products/vitamin-c-glow-mask-2-month-supply, iterationId: f1dffda7-59e4-4ee6-bee0-02cacd3bd80f\\\",\\\"ts\\\":1710091344459,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.admiremyskin.com/products/vitamin-c-glow-mask-2-month-supply, iterationId: f1dffda7-59e4-4ee6-bee0-02cacd3bd80f\\\",\\\"ts\\\":1710091344459,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344459}\\\",\\\"ts\\\":1710091344459,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344459,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344459}, latency: 0\\\",\\\"ts\\\":1710091344459,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.admiremyskin.com/products/vitamin-c-glow-mask-2-month-supply, iterationId: f1dffda7-59e4-4ee6-bee0-02cacd3bd80f\\\",\\\"ts\\\":1710091344459,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.admiremyskin.com/products/vitamin-c-glow-mask-2-month-supply, iterationId: f1dffda7-59e4-4ee6-bee0-02cacd3bd80f\\\",\\\"ts\\\":1710091344459,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.admiremyskin.com/products/vitamin-c-glow-mask-2-month-supply, iterationId: f1dffda7-59e4-4ee6-bee0-02cacd3bd80f\\\",\\\"ts\\\":1710091344460,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 198, recordSize: 2806, indexRecordBytes: 483141\\\",\\\"ts\\\":1710091344460,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.admiremyskin.com/products/vitamin-c-glow-mask-2-month-supply, indexRecordsCount: 199, indexRecordsBytes: 485947, numRecordsNotCheckpointed: 199, iterationId: f1dffda7-59e4-4ee6-bee0-02cacd3bd80f\\\",\\\"ts\\\":1710091344460,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.admiremyskin.com/products/vitamin-c-glow-mask-2-month-supply, iterationId: f1dffda7-59e4-4ee6-bee0-02cacd3bd80f\\\",\\\"ts\\\":1710091344460,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344460}\\\",\\\"ts\\\":1710091344460,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344460}, latency: 0\\\",\\\"ts\\\":1710091344460,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: f1dffda7-59e4-4ee6-bee0-02cacd3bd80f, iterationLatency: 18\\\",\\\"ts\\\":1710091344460,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 5dde96a8-0620-492d-a73b-1ae6ca48989e\\\",\\\"ts\\\":1710091344460,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344460}\\\",\\\"ts\\\":1710091344460,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344460}, latency: 0\\\",\\\"ts\\\":1710091344460,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 5dde96a8-0620-492d-a73b-1ae6ca48989e\\\",\\\"ts\\\":1710091344460,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 13\\\",\\\"ts\\\":1710091344472,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344472,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344472,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.africanews.com/2023/03/12/afrique-du-sud-les-frais-de-scolarite-accablent-les-etudiants/, iterationId: 5dde96a8-0620-492d-a73b-1ae6ca48989e\\\",\\\"ts\\\":1710091344472,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.africanews.com/2023/03/12/afrique-du-sud-les-frais-de-scolarite-accablent-les-etudiants/, iterationId: 5dde96a8-0620-492d-a73b-1ae6ca48989e\\\",\\\"ts\\\":1710091344472,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344472}\\\",\\\"ts\\\":1710091344472,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344472,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344472}, latency: 0\\\",\\\"ts\\\":1710091344472,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.africanews.com/2023/03/12/afrique-du-sud-les-frais-de-scolarite-accablent-les-etudiants/, iterationId: 5dde96a8-0620-492d-a73b-1ae6ca48989e\\\",\\\"ts\\\":1710091344472,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.africanews.com/2023/03/12/afrique-du-sud-les-frais-de-scolarite-accablent-les-etudiants/, iterationId: 5dde96a8-0620-492d-a73b-1ae6ca48989e\\\",\\\"ts\\\":1710091344472,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.africanews.com/2023/03/12/afrique-du-sud-les-frais-de-scolarite-accablent-les-etudiants/, iterationId: 5dde96a8-0620-492d-a73b-1ae6ca48989e\\\",\\\"ts\\\":1710091344473,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 199, recordSize: 3069, indexRecordBytes: 485947\\\",\\\"ts\\\":1710091344473,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.africanews.com/2023/03/12/afrique-du-sud-les-frais-de-scolarite-accablent-les-etudiants/, indexRecordsCount: 200, indexRecordsBytes: 489016, numRecordsNotCheckpointed: 200, iterationId: 5dde96a8-0620-492d-a73b-1ae6ca48989e\\\",\\\"ts\\\":1710091344473,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.africanews.com/2023/03/12/afrique-du-sud-les-frais-de-scolarite-accablent-les-etudiants/, iterationId: 5dde96a8-0620-492d-a73b-1ae6ca48989e\\\",\\\"ts\\\":1710091344473,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344473}\\\",\\\"ts\\\":1710091344473,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344473}, latency: 0\\\",\\\"ts\\\":1710091344473,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 5dde96a8-0620-492d-a73b-1ae6ca48989e, iterationLatency: 13\\\",\\\"ts\\\":1710091344473,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: d204bce2-b926-4b33-8161-4693b53aa675\\\",\\\"ts\\\":1710091344473,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344473}\\\",\\\"ts\\\":1710091344473,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344473}, latency: 0\\\",\\\"ts\\\":1710091344473,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: d204bce2-b926-4b33-8161-4693b53aa675\\\",\\\"ts\\\":1710091344473,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091344483,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344483,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344483,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.euronews.com/2015/11/10/aung-san-suu-kyi-je-suis-au-dessus-du-president, iterationId: d204bce2-b926-4b33-8161-4693b53aa675\\\",\\\"ts\\\":1710091344483,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.euronews.com/2015/11/10/aung-san-suu-kyi-je-suis-au-dessus-du-president, iterationId: d204bce2-b926-4b33-8161-4693b53aa675\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344484}\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344484}, latency: 0\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.euronews.com/2015/11/10/aung-san-suu-kyi-je-suis-au-dessus-du-president, iterationId: d204bce2-b926-4b33-8161-4693b53aa675\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.euronews.com/2015/11/10/aung-san-suu-kyi-je-suis-au-dessus-du-president, iterationId: d204bce2-b926-4b33-8161-4693b53aa675\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.euronews.com/2015/11/10/aung-san-suu-kyi-je-suis-au-dessus-du-president, iterationId: d204bce2-b926-4b33-8161-4693b53aa675\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 200, recordSize: 3118, indexRecordBytes: 489016\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.euronews.com/2015/11/10/aung-san-suu-kyi-je-suis-au-dessus-du-president, indexRecordsCount: 201, indexRecordsBytes: 492134, numRecordsNotCheckpointed: 201, iterationId: d204bce2-b926-4b33-8161-4693b53aa675\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.euronews.com/2015/11/10/aung-san-suu-kyi-je-suis-au-dessus-du-president, iterationId: d204bce2-b926-4b33-8161-4693b53aa675\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344484}\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344484}, latency: 0\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: d204bce2-b926-4b33-8161-4693b53aa675, iterationLatency: 11\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 32f7483c-daab-472d-a3cd-90670045d916\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344484}\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344484}, latency: 0\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 32f7483c-daab-472d-a3cd-90670045d916\\\",\\\"ts\\\":1710091344484,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091344495,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344495,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344495,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.gamesplanet.com/game/circle-empires-rivals-forces-of-nature-steam-key--4485-2?ref\\\\u003dvayaansias, iterationId: 32f7483c-daab-472d-a3cd-90670045d916\\\",\\\"ts\\\":1710091344495,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.gamesplanet.com/game/circle-empires-rivals-forces-of-nature-steam-key--4485-2?ref\\\\u003dvayaansias, iterationId: 32f7483c-daab-472d-a3cd-90670045d916\\\",\\\"ts\\\":1710091344495,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344495}\\\",\\\"ts\\\":1710091344495,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344495}, latency: 0\\\",\\\"ts\\\":1710091344496,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.gamesplanet.com/game/circle-empires-rivals-forces-of-nature-steam-key--4485-2?ref\\\\u003dvayaansias, iterationId: 32f7483c-daab-472d-a3cd-90670045d916\\\",\\\"ts\\\":1710091344496,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.gamesplanet.com/game/circle-empires-rivals-forces-of-nature-steam-key--4485-2?ref\\\\u003dvayaansias, iterationId: 32f7483c-daab-472d-a3cd-90670045d916\\\",\\\"ts\\\":1710091344496,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344495,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.gamesplanet.com/game/circle-empires-rivals-forces-of-nature-steam-key--4485-2?ref\\\\u003dvayaansias, iterationId: 32f7483c-daab-472d-a3cd-90670045d916\\\",\\\"ts\\\":1710091344496,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 201, recordSize: 3139, indexRecordBytes: 492134\\\",\\\"ts\\\":1710091344496,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.gamesplanet.com/game/circle-empires-rivals-forces-of-nature-steam-key--4485-2?ref\\\\u003dvayaansias, indexRecordsCount: 202, indexRecordsBytes: 495273, numRecordsNotCheckpointed: 202, iterationId: 32f7483c-daab-472d-a3cd-90670045d916\\\",\\\"ts\\\":1710091344496,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.gamesplanet.com/game/circle-empires-rivals-forces-of-nature-steam-key--4485-2?ref\\\\u003dvayaansias, iterationId: 32f7483c-daab-472d-a3cd-90670045d916\\\",\\\"ts\\\":1710091344496,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344496}\\\",\\\"ts\\\":1710091344496,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344496}, latency: 0\\\",\\\"ts\\\":1710091344496,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 32f7483c-daab-472d-a3cd-90670045d916, iterationLatency: 12\\\",\\\"ts\\\":1710091344496,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: c9ce51f9-d3c4-43df-88ef-a2d63cce59aa\\\",\\\"ts\\\":1710091344496,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344496}\\\",\\\"ts\\\":1710091344496,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344496}, latency: 0\\\",\\\"ts\\\":1710091344496,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: c9ce51f9-d3c4-43df-88ef-a2d63cce59aa\\\",\\\"ts\\\":1710091344496,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344508,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.ietlabs.com/m2520ct-3-variac-1503.html, iterationId: c9ce51f9-d3c4-43df-88ef-a2d63cce59aa\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.ietlabs.com/m2520ct-3-variac-1503.html, iterationId: c9ce51f9-d3c4-43df-88ef-a2d63cce59aa\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344509}\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344509}, latency: 0\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.ietlabs.com/m2520ct-3-variac-1503.html, iterationId: c9ce51f9-d3c4-43df-88ef-a2d63cce59aa\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.ietlabs.com/m2520ct-3-variac-1503.html, iterationId: c9ce51f9-d3c4-43df-88ef-a2d63cce59aa\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.ietlabs.com/m2520ct-3-variac-1503.html, iterationId: c9ce51f9-d3c4-43df-88ef-a2d63cce59aa\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 202, recordSize: 1389, indexRecordBytes: 495273\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.ietlabs.com/m2520ct-3-variac-1503.html, indexRecordsCount: 203, indexRecordsBytes: 496662, numRecordsNotCheckpointed: 203, iterationId: c9ce51f9-d3c4-43df-88ef-a2d63cce59aa\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.ietlabs.com/m2520ct-3-variac-1503.html, iterationId: c9ce51f9-d3c4-43df-88ef-a2d63cce59aa\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344509}\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344509}, latency: 0\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: c9ce51f9-d3c4-43df-88ef-a2d63cce59aa, iterationLatency: 13\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: c5ed802f-ce7f-4a4d-b6ba-ed6969121f99\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344509}\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344509}, latency: 0\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: c5ed802f-ce7f-4a4d-b6ba-ed6969121f99\\\",\\\"ts\\\":1710091344509,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091344520,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.jeffprod.com/blog/tags/vuejs/, iterationId: c5ed802f-ce7f-4a4d-b6ba-ed6969121f99\\\",\\\"ts\\\":1710091344520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.jeffprod.com/blog/tags/vuejs/, iterationId: c5ed802f-ce7f-4a4d-b6ba-ed6969121f99\\\",\\\"ts\\\":1710091344520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344520}\\\",\\\"ts\\\":1710091344520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344520}, latency: 0\\\",\\\"ts\\\":1710091344520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.jeffprod.com/blog/tags/vuejs/, iterationId: c5ed802f-ce7f-4a4d-b6ba-ed6969121f99\\\",\\\"ts\\\":1710091344520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.jeffprod.com/blog/tags/vuejs/, iterationId: c5ed802f-ce7f-4a4d-b6ba-ed6969121f99\\\",\\\"ts\\\":1710091344520,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344520,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.jeffprod.com/blog/tags/vuejs/, iterationId: c5ed802f-ce7f-4a4d-b6ba-ed6969121f99\\\",\\\"ts\\\":1710091344521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 203, recordSize: 569, indexRecordBytes: 496662\\\",\\\"ts\\\":1710091344521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.jeffprod.com/blog/tags/vuejs/, indexRecordsCount: 204, indexRecordsBytes: 497231, numRecordsNotCheckpointed: 204, iterationId: c5ed802f-ce7f-4a4d-b6ba-ed6969121f99\\\",\\\"ts\\\":1710091344521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.jeffprod.com/blog/tags/vuejs/, iterationId: c5ed802f-ce7f-4a4d-b6ba-ed6969121f99\\\",\\\"ts\\\":1710091344521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344521}\\\",\\\"ts\\\":1710091344521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344521}, latency: 0\\\",\\\"ts\\\":1710091344521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: c5ed802f-ce7f-4a4d-b6ba-ed6969121f99, iterationLatency: 12\\\",\\\"ts\\\":1710091344521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: bc41e90e-007e-4828-bc01-a4ace230de73\\\",\\\"ts\\\":1710091344521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344521}\\\",\\\"ts\\\":1710091344521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344521}, latency: 0\\\",\\\"ts\\\":1710091344521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: bc41e90e-007e-4828-bc01-a4ace230de73\\\",\\\"ts\\\":1710091344521,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 13\\\",\\\"ts\\\":1710091344533,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344533,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.m.wikipedia.org/wiki/Bernardus_Blok, iterationId: bc41e90e-007e-4828-bc01-a4ace230de73\\\",\\\"ts\\\":1710091344533,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.m.wikipedia.org/wiki/Bernardus_Blok, iterationId: bc41e90e-007e-4828-bc01-a4ace230de73\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344534}\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344534}, latency: 0\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.m.wikipedia.org/wiki/Bernardus_Blok, iterationId: bc41e90e-007e-4828-bc01-a4ace230de73\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.m.wikipedia.org/wiki/Bernardus_Blok, iterationId: bc41e90e-007e-4828-bc01-a4ace230de73\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.m.wikipedia.org/wiki/Bernardus_Blok, iterationId: bc41e90e-007e-4828-bc01-a4ace230de73\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 204, recordSize: 2397, indexRecordBytes: 497231\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.m.wikipedia.org/wiki/Bernardus_Blok, indexRecordsCount: 205, indexRecordsBytes: 499628, numRecordsNotCheckpointed: 205, iterationId: bc41e90e-007e-4828-bc01-a4ace230de73\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.m.wikipedia.org/wiki/Bernardus_Blok, iterationId: bc41e90e-007e-4828-bc01-a4ace230de73\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344534}\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344534}, latency: 0\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: bc41e90e-007e-4828-bc01-a4ace230de73, iterationLatency: 13\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 20de2cf0-fb5c-40ff-bfdf-b63532ac65b4\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344534}\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344534}, latency: 0\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 20de2cf0-fb5c-40ff-bfdf-b63532ac65b4\\\",\\\"ts\\\":1710091344534,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344546,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344547,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344547,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.nissan.ch/clients/wallbox.html, iterationId: 20de2cf0-fb5c-40ff-bfdf-b63532ac65b4\\\",\\\"ts\\\":1710091344547,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.nissan.ch/clients/wallbox.html, iterationId: 20de2cf0-fb5c-40ff-bfdf-b63532ac65b4\\\",\\\"ts\\\":1710091344547,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344547}\\\",\\\"ts\\\":1710091344547,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344547}, latency: 0\\\",\\\"ts\\\":1710091344547,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.nissan.ch/clients/wallbox.html, iterationId: 20de2cf0-fb5c-40ff-bfdf-b63532ac65b4\\\",\\\"ts\\\":1710091344547,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.nissan.ch/clients/wallbox.html, iterationId: 20de2cf0-fb5c-40ff-bfdf-b63532ac65b4\\\",\\\"ts\\\":1710091344547,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344547,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.nissan.ch/clients/wallbox.html, iterationId: 20de2cf0-fb5c-40ff-bfdf-b63532ac65b4\\\",\\\"ts\\\":1710091344548,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 205, recordSize: 5346, indexRecordBytes: 499628\\\",\\\"ts\\\":1710091344548,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.nissan.ch/clients/wallbox.html, indexRecordsCount: 206, indexRecordsBytes: 504974, numRecordsNotCheckpointed: 206, iterationId: 20de2cf0-fb5c-40ff-bfdf-b63532ac65b4\\\",\\\"ts\\\":1710091344548,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.nissan.ch/clients/wallbox.html, iterationId: 20de2cf0-fb5c-40ff-bfdf-b63532ac65b4\\\",\\\"ts\\\":1710091344548,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344548}\\\",\\\"ts\\\":1710091344548,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344548}, latency: 0\\\",\\\"ts\\\":1710091344548,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 20de2cf0-fb5c-40ff-bfdf-b63532ac65b4, iterationLatency: 14\\\",\\\"ts\\\":1710091344548,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: c3d20d5f-eeff-41d8-8f00-3f55291ff3dc\\\",\\\"ts\\\":1710091344548,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344548}\\\",\\\"ts\\\":1710091344548,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344548}, latency: 0\\\",\\\"ts\\\":1710091344548,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: c3d20d5f-eeff-41d8-8f00-3f55291ff3dc\\\",\\\"ts\\\":1710091344548,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091344558,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.pokernews.com/tours/wsop/2021-wsop/event-87-100000-high-roller/chips.267395.htm, iterationId: c3d20d5f-eeff-41d8-8f00-3f55291ff3dc\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.pokernews.com/tours/wsop/2021-wsop/event-87-100000-high-roller/chips.267395.htm, iterationId: c3d20d5f-eeff-41d8-8f00-3f55291ff3dc\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344559}\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344559}, latency: 0\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.pokernews.com/tours/wsop/2021-wsop/event-87-100000-high-roller/chips.267395.htm, iterationId: c3d20d5f-eeff-41d8-8f00-3f55291ff3dc\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.pokernews.com/tours/wsop/2021-wsop/event-87-100000-high-roller/chips.267395.htm, iterationId: c3d20d5f-eeff-41d8-8f00-3f55291ff3dc\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.pokernews.com/tours/wsop/2021-wsop/event-87-100000-high-roller/chips.267395.htm, iterationId: c3d20d5f-eeff-41d8-8f00-3f55291ff3dc\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 206, recordSize: 2959, indexRecordBytes: 504974\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.pokernews.com/tours/wsop/2021-wsop/event-87-100000-high-roller/chips.267395.htm, indexRecordsCount: 207, indexRecordsBytes: 507933, numRecordsNotCheckpointed: 207, iterationId: c3d20d5f-eeff-41d8-8f00-3f55291ff3dc\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.pokernews.com/tours/wsop/2021-wsop/event-87-100000-high-roller/chips.267395.htm, iterationId: c3d20d5f-eeff-41d8-8f00-3f55291ff3dc\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344559}\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344559}, latency: 0\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: c3d20d5f-eeff-41d8-8f00-3f55291ff3dc, iterationLatency: 11\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 11aa778a-daa4-4770-99c2-fbc1442d65b0\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344559}\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344559}, latency: 0\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 11aa778a-daa4-4770-99c2-fbc1442d65b0\\\",\\\"ts\\\":1710091344559,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.pornoseksfilmovi.org/tag/2/, iterationId: 11aa778a-daa4-4770-99c2-fbc1442d65b0\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.pornoseksfilmovi.org/tag/2/, iterationId: 11aa778a-daa4-4770-99c2-fbc1442d65b0\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344572}\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344572}, latency: 0\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.pornoseksfilmovi.org/tag/2/, iterationId: 11aa778a-daa4-4770-99c2-fbc1442d65b0\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.pornoseksfilmovi.org/tag/2/, iterationId: 11aa778a-daa4-4770-99c2-fbc1442d65b0\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.pornoseksfilmovi.org/tag/2/, iterationId: 11aa778a-daa4-4770-99c2-fbc1442d65b0\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 207, recordSize: 2148, indexRecordBytes: 507933\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.pornoseksfilmovi.org/tag/2/, indexRecordsCount: 208, indexRecordsBytes: 510081, numRecordsNotCheckpointed: 208, iterationId: 11aa778a-daa4-4770-99c2-fbc1442d65b0\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.pornoseksfilmovi.org/tag/2/, iterationId: 11aa778a-daa4-4770-99c2-fbc1442d65b0\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344572}\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344572}, latency: 0\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 11aa778a-daa4-4770-99c2-fbc1442d65b0, iterationLatency: 13\\\",\\\"ts\\\":1710091344572,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: f2c156f5-8fea-4a53-907f-88140d66dd8d\\\",\\\"ts\\\":1710091344573,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344573}\\\",\\\"ts\\\":1710091344573,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344573}, latency: 0\\\",\\\"ts\\\":1710091344573,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: f2c156f5-8fea-4a53-907f-88140d66dd8d\\\",\\\"ts\\\":1710091344573,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 14\\\",\\\"ts\\\":1710091344586,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344587,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344587,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.rebeccarulenh.com/4187-gabbi-garcia-height-weight-age-body-statistics, iterationId: f2c156f5-8fea-4a53-907f-88140d66dd8d\\\",\\\"ts\\\":1710091344587,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.rebeccarulenh.com/4187-gabbi-garcia-height-weight-age-body-statistics, iterationId: f2c156f5-8fea-4a53-907f-88140d66dd8d\\\",\\\"ts\\\":1710091344587,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344587}\\\",\\\"ts\\\":1710091344587,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344587}, latency: 0\\\",\\\"ts\\\":1710091344587,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.rebeccarulenh.com/4187-gabbi-garcia-height-weight-age-body-statistics, iterationId: f2c156f5-8fea-4a53-907f-88140d66dd8d\\\",\\\"ts\\\":1710091344587,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.rebeccarulenh.com/4187-gabbi-garcia-height-weight-age-body-statistics, iterationId: f2c156f5-8fea-4a53-907f-88140d66dd8d\\\",\\\"ts\\\":1710091344587,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344587,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.rebeccarulenh.com/4187-gabbi-garcia-height-weight-age-body-statistics, iterationId: f2c156f5-8fea-4a53-907f-88140d66dd8d\\\",\\\"ts\\\":1710091344588,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 208, recordSize: 4488, indexRecordBytes: 510081\\\",\\\"ts\\\":1710091344588,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.rebeccarulenh.com/4187-gabbi-garcia-height-weight-age-body-statistics, indexRecordsCount: 209, indexRecordsBytes: 514569, numRecordsNotCheckpointed: 209, iterationId: f2c156f5-8fea-4a53-907f-88140d66dd8d\\\",\\\"ts\\\":1710091344588,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.rebeccarulenh.com/4187-gabbi-garcia-height-weight-age-body-statistics, iterationId: f2c156f5-8fea-4a53-907f-88140d66dd8d\\\",\\\"ts\\\":1710091344588,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344588}\\\",\\\"ts\\\":1710091344588,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344588}, latency: 0\\\",\\\"ts\\\":1710091344588,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: f2c156f5-8fea-4a53-907f-88140d66dd8d, iterationLatency: 15\\\",\\\"ts\\\":1710091344588,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: a1e7259d-143e-4d64-a38f-7b19b6ac3922\\\",\\\"ts\\\":1710091344588,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344588}\\\",\\\"ts\\\":1710091344588,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344588}, latency: 0\\\",\\\"ts\\\":1710091344588,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: a1e7259d-143e-4d64-a38f-7b19b6ac3922\\\",\\\"ts\\\":1710091344588,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344599,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.respectance.com/tribute/jenni-rivera, iterationId: a1e7259d-143e-4d64-a38f-7b19b6ac3922\\\",\\\"ts\\\":1710091344599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.respectance.com/tribute/jenni-rivera, iterationId: a1e7259d-143e-4d64-a38f-7b19b6ac3922\\\",\\\"ts\\\":1710091344599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344599,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344599}\\\",\\\"ts\\\":1710091344599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344599}, latency: 0\\\",\\\"ts\\\":1710091344599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.respectance.com/tribute/jenni-rivera, iterationId: a1e7259d-143e-4d64-a38f-7b19b6ac3922\\\",\\\"ts\\\":1710091344599,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.respectance.com/tribute/jenni-rivera, iterationId: a1e7259d-143e-4d64-a38f-7b19b6ac3922\\\",\\\"ts\\\":1710091344600,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.respectance.com/tribute/jenni-rivera, iterationId: a1e7259d-143e-4d64-a38f-7b19b6ac3922\\\",\\\"ts\\\":1710091344600,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 209, recordSize: 852, indexRecordBytes: 514569\\\",\\\"ts\\\":1710091344600,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.respectance.com/tribute/jenni-rivera, indexRecordsCount: 210, indexRecordsBytes: 515421, numRecordsNotCheckpointed: 210, iterationId: a1e7259d-143e-4d64-a38f-7b19b6ac3922\\\",\\\"ts\\\":1710091344600,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.respectance.com/tribute/jenni-rivera, iterationId: a1e7259d-143e-4d64-a38f-7b19b6ac3922\\\",\\\"ts\\\":1710091344600,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344600}\\\",\\\"ts\\\":1710091344600,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344600}, latency: 0\\\",\\\"ts\\\":1710091344600,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: a1e7259d-143e-4d64-a38f-7b19b6ac3922, iterationLatency: 12\\\",\\\"ts\\\":1710091344600,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: b44c43fb-1554-4cc1-bc73-4275a168a72e\\\",\\\"ts\\\":1710091344600,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344600}\\\",\\\"ts\\\":1710091344600,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344600}, latency: 0\\\",\\\"ts\\\":1710091344600,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: b44c43fb-1554-4cc1-bc73-4275a168a72e\\\",\\\"ts\\\":1710091344600,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.respectance.com/tribute/patrice-lumumba-malcolm-oneal, iterationId: b44c43fb-1554-4cc1-bc73-4275a168a72e\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.respectance.com/tribute/patrice-lumumba-malcolm-oneal, iterationId: b44c43fb-1554-4cc1-bc73-4275a168a72e\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344612}\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344612}, latency: 0\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.respectance.com/tribute/patrice-lumumba-malcolm-oneal, iterationId: b44c43fb-1554-4cc1-bc73-4275a168a72e\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.respectance.com/tribute/patrice-lumumba-malcolm-oneal, iterationId: b44c43fb-1554-4cc1-bc73-4275a168a72e\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.respectance.com/tribute/patrice-lumumba-malcolm-oneal, iterationId: b44c43fb-1554-4cc1-bc73-4275a168a72e\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 210, recordSize: 790, indexRecordBytes: 515421\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.respectance.com/tribute/patrice-lumumba-malcolm-oneal, indexRecordsCount: 211, indexRecordsBytes: 516211, numRecordsNotCheckpointed: 211, iterationId: b44c43fb-1554-4cc1-bc73-4275a168a72e\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.respectance.com/tribute/patrice-lumumba-malcolm-oneal, iterationId: b44c43fb-1554-4cc1-bc73-4275a168a72e\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344612}\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344612}, latency: 0\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: b44c43fb-1554-4cc1-bc73-4275a168a72e, iterationLatency: 12\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: ae60f233-4059-43b4-a270-7d00de6c9e07\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344612}\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344612}, latency: 0\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: ae60f233-4059-43b4-a270-7d00de6c9e07\\\",\\\"ts\\\":1710091344612,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 13\\\",\\\"ts\\\":1710091344625,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344625,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344625,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.sharecast.com/actualit%C3%A9s/nouvelles-et-annonces/le-gouvernement-va-investir-1-milliard-de-livres-dans-le-secteur-des-puces-au-royaume-uni-13451450.html, iterationId: ae60f233-4059-43b4-a270-7d00de6c9e07\\\",\\\"ts\\\":1710091344625,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.sharecast.com/actualit%C3%A9s/nouvelles-et-annonces/le-gouvernement-va-investir-1-milliard-de-livres-dans-le-secteur-des-puces-au-royaume-uni-13451450.html, iterationId: ae60f233-4059-43b4-a270-7d00de6c9e07\\\",\\\"ts\\\":1710091344626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344626}\\\",\\\"ts\\\":1710091344626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344626}, latency: 0\\\",\\\"ts\\\":1710091344626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.sharecast.com/actualit%C3%A9s/nouvelles-et-annonces/le-gouvernement-va-investir-1-milliard-de-livres-dans-le-secteur-des-puces-au-royaume-uni-13451450.html, iterationId: ae60f233-4059-43b4-a270-7d00de6c9e07\\\",\\\"ts\\\":1710091344626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.sharecast.com/actualit%C3%A9s/nouvelles-et-annonces/le-gouvernement-va-investir-1-milliard-de-livres-dans-le-secteur-des-puces-au-royaume-uni-13451450.html, iterationId: ae60f233-4059-43b4-a270-7d00de6c9e07\\\",\\\"ts\\\":1710091344626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344626,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.sharecast.com/actualit%C3%A9s/nouvelles-et-annonces/le-gouvernement-va-investir-1-milliard-de-livres-dans-le-secteur-des-puces-au-royaume-uni-13451450.html, iterationId: ae60f233-4059-43b4-a270-7d00de6c9e07\\\",\\\"ts\\\":1710091344626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 211, recordSize: 4049, indexRecordBytes: 516211\\\",\\\"ts\\\":1710091344626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.sharecast.com/actualit%C3%A9s/nouvelles-et-annonces/le-gouvernement-va-investir-1-milliard-de-livres-dans-le-secteur-des-puces-au-royaume-uni-13451450.html, indexRecordsCount: 212, indexRecordsBytes: 520260, numRecordsNotCheckpointed: 212, iterationId: ae60f233-4059-43b4-a270-7d00de6c9e07\\\",\\\"ts\\\":1710091344626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.sharecast.com/actualit%C3%A9s/nouvelles-et-annonces/le-gouvernement-va-investir-1-milliard-de-livres-dans-le-secteur-des-puces-au-royaume-uni-13451450.html, iterationId: ae60f233-4059-43b4-a270-7d00de6c9e07\\\",\\\"ts\\\":1710091344626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344626}\\\",\\\"ts\\\":1710091344626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344626}, latency: 0\\\",\\\"ts\\\":1710091344626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: ae60f233-4059-43b4-a270-7d00de6c9e07, iterationLatency: 14\\\",\\\"ts\\\":1710091344626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: aa628087-f64c-4a0e-a4f4-ab3a54544292\\\",\\\"ts\\\":1710091344626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344626}\\\",\\\"ts\\\":1710091344626,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344626}, latency: 0\\\",\\\"ts\\\":1710091344627,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: aa628087-f64c-4a0e-a4f4-ab3a54544292\\\",\\\"ts\\\":1710091344627,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344638,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344638,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344638,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.slideserve.com/bree/pulping-and-bleaching-pse-476, iterationId: aa628087-f64c-4a0e-a4f4-ab3a54544292\\\",\\\"ts\\\":1710091344638,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.slideserve.com/bree/pulping-and-bleaching-pse-476, iterationId: aa628087-f64c-4a0e-a4f4-ab3a54544292\\\",\\\"ts\\\":1710091344638,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344638}\\\",\\\"ts\\\":1710091344638,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344638}, latency: 0\\\",\\\"ts\\\":1710091344638,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.slideserve.com/bree/pulping-and-bleaching-pse-476, iterationId: aa628087-f64c-4a0e-a4f4-ab3a54544292\\\",\\\"ts\\\":1710091344638,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.slideserve.com/bree/pulping-and-bleaching-pse-476, iterationId: aa628087-f64c-4a0e-a4f4-ab3a54544292\\\",\\\"ts\\\":1710091344639,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344639,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.slideserve.com/bree/pulping-and-bleaching-pse-476, iterationId: aa628087-f64c-4a0e-a4f4-ab3a54544292\\\",\\\"ts\\\":1710091344639,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 212, recordSize: 4997, indexRecordBytes: 520260\\\",\\\"ts\\\":1710091344639,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.slideserve.com/bree/pulping-and-bleaching-pse-476, indexRecordsCount: 213, indexRecordsBytes: 525257, numRecordsNotCheckpointed: 213, iterationId: aa628087-f64c-4a0e-a4f4-ab3a54544292\\\",\\\"ts\\\":1710091344639,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.slideserve.com/bree/pulping-and-bleaching-pse-476, iterationId: aa628087-f64c-4a0e-a4f4-ab3a54544292\\\",\\\"ts\\\":1710091344639,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344639}\\\",\\\"ts\\\":1710091344639,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344639}, latency: 0\\\",\\\"ts\\\":1710091344639,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: aa628087-f64c-4a0e-a4f4-ab3a54544292, iterationLatency: 13\\\",\\\"ts\\\":1710091344639,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: fe9ba90b-ade0-430e-bbf8-30a5dadda700\\\",\\\"ts\\\":1710091344639,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344639}\\\",\\\"ts\\\":1710091344639,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344639}, latency: 0\\\",\\\"ts\\\":1710091344639,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: fe9ba90b-ade0-430e-bbf8-30a5dadda700\\\",\\\"ts\\\":1710091344639,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 13\\\",\\\"ts\\\":1710091344652,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344653,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344653,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.slideshare.net/vanastac1o/proposta-oensinodagramaticaemlinguaportuguesa, iterationId: fe9ba90b-ade0-430e-bbf8-30a5dadda700\\\",\\\"ts\\\":1710091344653,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.slideshare.net/vanastac1o/proposta-oensinodagramaticaemlinguaportuguesa, iterationId: fe9ba90b-ade0-430e-bbf8-30a5dadda700\\\",\\\"ts\\\":1710091344653,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344653}\\\",\\\"ts\\\":1710091344653,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344653}, latency: 0\\\",\\\"ts\\\":1710091344653,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.slideshare.net/vanastac1o/proposta-oensinodagramaticaemlinguaportuguesa, iterationId: fe9ba90b-ade0-430e-bbf8-30a5dadda700\\\",\\\"ts\\\":1710091344653,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.slideshare.net/vanastac1o/proposta-oensinodagramaticaemlinguaportuguesa, iterationId: fe9ba90b-ade0-430e-bbf8-30a5dadda700\\\",\\\"ts\\\":1710091344653,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344653,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.slideshare.net/vanastac1o/proposta-oensinodagramaticaemlinguaportuguesa, iterationId: fe9ba90b-ade0-430e-bbf8-30a5dadda700\\\",\\\"ts\\\":1710091344654,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 213, recordSize: 6800, indexRecordBytes: 525257\\\",\\\"ts\\\":1710091344654,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.slideshare.net/vanastac1o/proposta-oensinodagramaticaemlinguaportuguesa, indexRecordsCount: 214, indexRecordsBytes: 532057, numRecordsNotCheckpointed: 214, iterationId: fe9ba90b-ade0-430e-bbf8-30a5dadda700\\\",\\\"ts\\\":1710091344654,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.slideshare.net/vanastac1o/proposta-oensinodagramaticaemlinguaportuguesa, iterationId: fe9ba90b-ade0-430e-bbf8-30a5dadda700\\\",\\\"ts\\\":1710091344654,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344654}\\\",\\\"ts\\\":1710091344654,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344654}, latency: 0\\\",\\\"ts\\\":1710091344654,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: fe9ba90b-ade0-430e-bbf8-30a5dadda700, iterationLatency: 15\\\",\\\"ts\\\":1710091344654,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: cb72a4c1-723a-42dc-9223-e99d3085b683\\\",\\\"ts\\\":1710091344654,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344654}\\\",\\\"ts\\\":1710091344654,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344654}, latency: 0\\\",\\\"ts\\\":1710091344654,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: cb72a4c1-723a-42dc-9223-e99d3085b683\\\",\\\"ts\\\":1710091344654,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 16\\\",\\\"ts\\\":1710091344669,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344669,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344669,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.strikingly.com/blog/posts/7-secrets-pour-une-entreprise-de-podcast-rentable, iterationId: cb72a4c1-723a-42dc-9223-e99d3085b683\\\",\\\"ts\\\":1710091344669,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.strikingly.com/blog/posts/7-secrets-pour-une-entreprise-de-podcast-rentable, iterationId: cb72a4c1-723a-42dc-9223-e99d3085b683\\\",\\\"ts\\\":1710091344669,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344669}\\\",\\\"ts\\\":1710091344669,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344669,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344669}, latency: 0\\\",\\\"ts\\\":1710091344669,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.strikingly.com/blog/posts/7-secrets-pour-une-entreprise-de-podcast-rentable, iterationId: cb72a4c1-723a-42dc-9223-e99d3085b683\\\",\\\"ts\\\":1710091344669,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.strikingly.com/blog/posts/7-secrets-pour-une-entreprise-de-podcast-rentable, iterationId: cb72a4c1-723a-42dc-9223-e99d3085b683\\\",\\\"ts\\\":1710091344669,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.strikingly.com/blog/posts/7-secrets-pour-une-entreprise-de-podcast-rentable, iterationId: cb72a4c1-723a-42dc-9223-e99d3085b683\\\",\\\"ts\\\":1710091344671,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 214, recordSize: 8617, indexRecordBytes: 532057\\\",\\\"ts\\\":1710091344671,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.strikingly.com/blog/posts/7-secrets-pour-une-entreprise-de-podcast-rentable, indexRecordsCount: 215, indexRecordsBytes: 540674, numRecordsNotCheckpointed: 215, iterationId: cb72a4c1-723a-42dc-9223-e99d3085b683\\\",\\\"ts\\\":1710091344671,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.strikingly.com/blog/posts/7-secrets-pour-une-entreprise-de-podcast-rentable, iterationId: cb72a4c1-723a-42dc-9223-e99d3085b683\\\",\\\"ts\\\":1710091344671,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344671}\\\",\\\"ts\\\":1710091344671,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344671}, latency: 0\\\",\\\"ts\\\":1710091344671,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: cb72a4c1-723a-42dc-9223-e99d3085b683, iterationLatency: 17\\\",\\\"ts\\\":1710091344671,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 429a0889-2788-4c14-9fc7-7e2a6e55552c\\\",\\\"ts\\\":1710091344671,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344671}\\\",\\\"ts\\\":1710091344671,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344671}, latency: 0\\\",\\\"ts\\\":1710091344671,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 429a0889-2788-4c14-9fc7-7e2a6e55552c\\\",\\\"ts\\\":1710091344671,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344681,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344681,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344681,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.support.procore.com/products/online/user-guide/company-level/timecard/tutorials/delete-a-timecard, iterationId: 429a0889-2788-4c14-9fc7-7e2a6e55552c\\\",\\\"ts\\\":1710091344681,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.support.procore.com/products/online/user-guide/company-level/timecard/tutorials/delete-a-timecard, iterationId: 429a0889-2788-4c14-9fc7-7e2a6e55552c\\\",\\\"ts\\\":1710091344681,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344681}\\\",\\\"ts\\\":1710091344681,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344681,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344681}, latency: 0\\\",\\\"ts\\\":1710091344681,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.support.procore.com/products/online/user-guide/company-level/timecard/tutorials/delete-a-timecard, iterationId: 429a0889-2788-4c14-9fc7-7e2a6e55552c\\\",\\\"ts\\\":1710091344681,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.support.procore.com/products/online/user-guide/company-level/timecard/tutorials/delete-a-timecard, iterationId: 429a0889-2788-4c14-9fc7-7e2a6e55552c\\\",\\\"ts\\\":1710091344681,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.support.procore.com/products/online/user-guide/company-level/timecard/tutorials/delete-a-timecard, iterationId: 429a0889-2788-4c14-9fc7-7e2a6e55552c\\\",\\\"ts\\\":1710091344682,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 215, recordSize: 1312, indexRecordBytes: 540674\\\",\\\"ts\\\":1710091344682,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.support.procore.com/products/online/user-guide/company-level/timecard/tutorials/delete-a-timecard, indexRecordsCount: 216, indexRecordsBytes: 541986, numRecordsNotCheckpointed: 216, iterationId: 429a0889-2788-4c14-9fc7-7e2a6e55552c\\\",\\\"ts\\\":1710091344682,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.support.procore.com/products/online/user-guide/company-level/timecard/tutorials/delete-a-timecard, iterationId: 429a0889-2788-4c14-9fc7-7e2a6e55552c\\\",\\\"ts\\\":1710091344682,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344682}\\\",\\\"ts\\\":1710091344682,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344682}, latency: 0\\\",\\\"ts\\\":1710091344682,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 429a0889-2788-4c14-9fc7-7e2a6e55552c, iterationLatency: 11\\\",\\\"ts\\\":1710091344682,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 02985e72-f5bd-40cd-9add-fc90b772af5c\\\",\\\"ts\\\":1710091344682,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344682}\\\",\\\"ts\\\":1710091344682,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344682}, latency: 0\\\",\\\"ts\\\":1710091344682,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 02985e72-f5bd-40cd-9add-fc90b772af5c\\\",\\\"ts\\\":1710091344682,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 17\\\",\\\"ts\\\":1710091344698,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.topwinkeychain.com/blogs-detail/how-to-design-eye-catching-custom-badges-that-stand-out, iterationId: 02985e72-f5bd-40cd-9add-fc90b772af5c\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.topwinkeychain.com/blogs-detail/how-to-design-eye-catching-custom-badges-that-stand-out, iterationId: 02985e72-f5bd-40cd-9add-fc90b772af5c\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344699}\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344699}, latency: 0\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.topwinkeychain.com/blogs-detail/how-to-design-eye-catching-custom-badges-that-stand-out, iterationId: 02985e72-f5bd-40cd-9add-fc90b772af5c\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.topwinkeychain.com/blogs-detail/how-to-design-eye-catching-custom-badges-that-stand-out, iterationId: 02985e72-f5bd-40cd-9add-fc90b772af5c\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.topwinkeychain.com/blogs-detail/how-to-design-eye-catching-custom-badges-that-stand-out, iterationId: 02985e72-f5bd-40cd-9add-fc90b772af5c\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 216, recordSize: 670, indexRecordBytes: 541986\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.topwinkeychain.com/blogs-detail/how-to-design-eye-catching-custom-badges-that-stand-out, indexRecordsCount: 217, indexRecordsBytes: 542656, numRecordsNotCheckpointed: 217, iterationId: 02985e72-f5bd-40cd-9add-fc90b772af5c\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.topwinkeychain.com/blogs-detail/how-to-design-eye-catching-custom-badges-that-stand-out, iterationId: 02985e72-f5bd-40cd-9add-fc90b772af5c\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344699}\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344699}, latency: 0\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 02985e72-f5bd-40cd-9add-fc90b772af5c, iterationLatency: 17\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 9407d690-92cd-4434-9162-3532048adb46\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344699}\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344699}, latency: 0\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 9407d690-92cd-4434-9162-3532048adb46\\\",\\\"ts\\\":1710091344699,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 16\\\",\\\"ts\\\":1710091344715,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344715,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344715,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.virtualdj.com/wiki/atprkeychainpassword.html, iterationId: 9407d690-92cd-4434-9162-3532048adb46\\\",\\\"ts\\\":1710091344715,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.virtualdj.com/wiki/atprkeychainpassword.html, iterationId: 9407d690-92cd-4434-9162-3532048adb46\\\",\\\"ts\\\":1710091344715,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344715}\\\",\\\"ts\\\":1710091344715,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344715,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344715}, latency: 0\\\",\\\"ts\\\":1710091344716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.virtualdj.com/wiki/atprkeychainpassword.html, iterationId: 9407d690-92cd-4434-9162-3532048adb46\\\",\\\"ts\\\":1710091344716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.virtualdj.com/wiki/atprkeychainpassword.html, iterationId: 9407d690-92cd-4434-9162-3532048adb46\\\",\\\"ts\\\":1710091344716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.virtualdj.com/wiki/atprkeychainpassword.html, iterationId: 9407d690-92cd-4434-9162-3532048adb46\\\",\\\"ts\\\":1710091344716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 217, recordSize: 1655, indexRecordBytes: 542656\\\",\\\"ts\\\":1710091344716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.virtualdj.com/wiki/atprkeychainpassword.html, indexRecordsCount: 218, indexRecordsBytes: 544311, numRecordsNotCheckpointed: 218, iterationId: 9407d690-92cd-4434-9162-3532048adb46\\\",\\\"ts\\\":1710091344716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.virtualdj.com/wiki/atprkeychainpassword.html, iterationId: 9407d690-92cd-4434-9162-3532048adb46\\\",\\\"ts\\\":1710091344716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344716}\\\",\\\"ts\\\":1710091344716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344716}, latency: 0\\\",\\\"ts\\\":1710091344716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 9407d690-92cd-4434-9162-3532048adb46, iterationLatency: 17\\\",\\\"ts\\\":1710091344716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: f7e3302d-ef1b-416a-ba4a-f01cfec9dada\\\",\\\"ts\\\":1710091344716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344716}\\\",\\\"ts\\\":1710091344716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344716}, latency: 0\\\",\\\"ts\\\":1710091344716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: f7e3302d-ef1b-416a-ba4a-f01cfec9dada\\\",\\\"ts\\\":1710091344716,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 13\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.wikiarquitectura.com/?s\\\\u003droma_palacio_mc3basica_7-1-2-2, iterationId: f7e3302d-ef1b-416a-ba4a-f01cfec9dada\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.wikiarquitectura.com/?s\\\\u003droma_palacio_mc3basica_7-1-2-2, iterationId: f7e3302d-ef1b-416a-ba4a-f01cfec9dada\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344729}\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344729}, latency: 0\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.wikiarquitectura.com/?s\\\\u003droma_palacio_mc3basica_7-1-2-2, iterationId: f7e3302d-ef1b-416a-ba4a-f01cfec9dada\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.wikiarquitectura.com/?s\\\\u003droma_palacio_mc3basica_7-1-2-2, iterationId: f7e3302d-ef1b-416a-ba4a-f01cfec9dada\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.wikiarquitectura.com/?s\\\\u003droma_palacio_mc3basica_7-1-2-2, iterationId: f7e3302d-ef1b-416a-ba4a-f01cfec9dada\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 218, recordSize: 513, indexRecordBytes: 544311\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.wikiarquitectura.com/?s\\\\u003droma_palacio_mc3basica_7-1-2-2, indexRecordsCount: 219, indexRecordsBytes: 544824, numRecordsNotCheckpointed: 219, iterationId: f7e3302d-ef1b-416a-ba4a-f01cfec9dada\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.wikiarquitectura.com/?s\\\\u003droma_palacio_mc3basica_7-1-2-2, iterationId: f7e3302d-ef1b-416a-ba4a-f01cfec9dada\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344729}\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344729}, latency: 0\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: f7e3302d-ef1b-416a-ba4a-f01cfec9dada, iterationLatency: 13\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 6edd9ef0-0242-47e0-943d-38c7c7eb28a0\\\",\\\"ts\\\":1710091344729,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344730}\\\",\\\"ts\\\":1710091344730,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344730}, latency: 0\\\",\\\"ts\\\":1710091344730,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 6edd9ef0-0242-47e0-943d-38c7c7eb28a0\\\",\\\"ts\\\":1710091344730,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 16\\\",\\\"ts\\\":1710091344746,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344746,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344746,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fr.wto-laser.com/Machine-%C3%A0-cintrer-automatique-de-r%C3%A8gle-en-acier-1PT%2C-2PT%2C-3PT%2C-4PT-pour-la-lame-de-matrice-pd73943387.html, iterationId: 6edd9ef0-0242-47e0-943d-38c7c7eb28a0\\\",\\\"ts\\\":1710091344746,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fr.wto-laser.com/Machine-%C3%A0-cintrer-automatique-de-r%C3%A8gle-en-acier-1PT%2C-2PT%2C-3PT%2C-4PT-pour-la-lame-de-matrice-pd73943387.html, iterationId: 6edd9ef0-0242-47e0-943d-38c7c7eb28a0\\\",\\\"ts\\\":1710091344746,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344746}\\\",\\\"ts\\\":1710091344746,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344746}, latency: 0\\\",\\\"ts\\\":1710091344746,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fr.wto-laser.com/Machine-%C3%A0-cintrer-automatique-de-r%C3%A8gle-en-acier-1PT%2C-2PT%2C-3PT%2C-4PT-pour-la-lame-de-matrice-pd73943387.html, iterationId: 6edd9ef0-0242-47e0-943d-38c7c7eb28a0\\\",\\\"ts\\\":1710091344746,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fr.wto-laser.com/Machine-%C3%A0-cintrer-automatique-de-r%C3%A8gle-en-acier-1PT%2C-2PT%2C-3PT%2C-4PT-pour-la-lame-de-matrice-pd73943387.html, iterationId: 6edd9ef0-0242-47e0-943d-38c7c7eb28a0\\\",\\\"ts\\\":1710091344746,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344746,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fr.wto-laser.com/Machine-%C3%A0-cintrer-automatique-de-r%C3%A8gle-en-acier-1PT%2C-2PT%2C-3PT%2C-4PT-pour-la-lame-de-matrice-pd73943387.html, iterationId: 6edd9ef0-0242-47e0-943d-38c7c7eb28a0\\\",\\\"ts\\\":1710091344747,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 219, recordSize: 4222, indexRecordBytes: 544824\\\",\\\"ts\\\":1710091344747,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fr.wto-laser.com/Machine-%C3%A0-cintrer-automatique-de-r%C3%A8gle-en-acier-1PT%2C-2PT%2C-3PT%2C-4PT-pour-la-lame-de-matrice-pd73943387.html, indexRecordsCount: 220, indexRecordsBytes: 549046, numRecordsNotCheckpointed: 220, iterationId: 6edd9ef0-0242-47e0-943d-38c7c7eb28a0\\\",\\\"ts\\\":1710091344747,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fr.wto-laser.com/Machine-%C3%A0-cintrer-automatique-de-r%C3%A8gle-en-acier-1PT%2C-2PT%2C-3PT%2C-4PT-pour-la-lame-de-matrice-pd73943387.html, iterationId: 6edd9ef0-0242-47e0-943d-38c7c7eb28a0\\\",\\\"ts\\\":1710091344747,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344747}\\\",\\\"ts\\\":1710091344747,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344747}, latency: 0\\\",\\\"ts\\\":1710091344747,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 6edd9ef0-0242-47e0-943d-38c7c7eb28a0, iterationLatency: 18\\\",\\\"ts\\\":1710091344747,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: ff2206b4-b6be-4496-b373-875a5572356d\\\",\\\"ts\\\":1710091344747,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344747}\\\",\\\"ts\\\":1710091344747,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344747}, latency: 0\\\",\\\"ts\\\":1710091344747,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: ff2206b4-b6be-4496-b373-875a5572356d\\\",\\\"ts\\\":1710091344747,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 10\\\",\\\"ts\\\":1710091344756,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344756,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344756,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fra.de.distfiles.macports.org/R-ConvergenceConcepts/?C\\\\u003dS;O\\\\u003dA, iterationId: ff2206b4-b6be-4496-b373-875a5572356d\\\",\\\"ts\\\":1710091344756,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fra.de.distfiles.macports.org/R-ConvergenceConcepts/?C\\\\u003dS;O\\\\u003dA, iterationId: ff2206b4-b6be-4496-b373-875a5572356d\\\",\\\"ts\\\":1710091344756,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344756}\\\",\\\"ts\\\":1710091344756,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344756,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344756}, latency: 0\\\",\\\"ts\\\":1710091344756,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fra.de.distfiles.macports.org/R-ConvergenceConcepts/?C\\\\u003dS;O\\\\u003dA, iterationId: ff2206b4-b6be-4496-b373-875a5572356d\\\",\\\"ts\\\":1710091344757,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fra.de.distfiles.macports.org/R-ConvergenceConcepts/?C\\\\u003dS;O\\\\u003dA, iterationId: ff2206b4-b6be-4496-b373-875a5572356d\\\",\\\"ts\\\":1710091344757,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fra.de.distfiles.macports.org/R-ConvergenceConcepts/?C\\\\u003dS;O\\\\u003dA, iterationId: ff2206b4-b6be-4496-b373-875a5572356d\\\",\\\"ts\\\":1710091344757,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 220, recordSize: 387, indexRecordBytes: 549046\\\",\\\"ts\\\":1710091344757,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fra.de.distfiles.macports.org/R-ConvergenceConcepts/?C\\\\u003dS;O\\\\u003dA, indexRecordsCount: 221, indexRecordsBytes: 549433, numRecordsNotCheckpointed: 221, iterationId: ff2206b4-b6be-4496-b373-875a5572356d\\\",\\\"ts\\\":1710091344757,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fra.de.distfiles.macports.org/R-ConvergenceConcepts/?C\\\\u003dS;O\\\\u003dA, iterationId: ff2206b4-b6be-4496-b373-875a5572356d\\\",\\\"ts\\\":1710091344757,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344757}\\\",\\\"ts\\\":1710091344757,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344757}, latency: 0\\\",\\\"ts\\\":1710091344757,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: ff2206b4-b6be-4496-b373-875a5572356d, iterationLatency: 10\\\",\\\"ts\\\":1710091344757,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 9afbaf9b-3be4-4d61-a3c9-de6935faaf44\\\",\\\"ts\\\":1710091344757,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344757}\\\",\\\"ts\\\":1710091344757,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344757}, latency: 0\\\",\\\"ts\\\":1710091344757,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 9afbaf9b-3be4-4d61-a3c9-de6935faaf44\\\",\\\"ts\\\":1710091344757,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 14\\\",\\\"ts\\\":1710091344771,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344771,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344771,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fra.de.distfiles.macports.org/aspectj/?C\\\\u003dD;O\\\\u003dA, iterationId: 9afbaf9b-3be4-4d61-a3c9-de6935faaf44\\\",\\\"ts\\\":1710091344771,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fra.de.distfiles.macports.org/aspectj/?C\\\\u003dD;O\\\\u003dA, iterationId: 9afbaf9b-3be4-4d61-a3c9-de6935faaf44\\\",\\\"ts\\\":1710091344771,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344771}\\\",\\\"ts\\\":1710091344771,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344771}, latency: 0\\\",\\\"ts\\\":1710091344771,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fra.de.distfiles.macports.org/aspectj/?C\\\\u003dD;O\\\\u003dA, iterationId: 9afbaf9b-3be4-4d61-a3c9-de6935faaf44\\\",\\\"ts\\\":1710091344772,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fra.de.distfiles.macports.org/aspectj/?C\\\\u003dD;O\\\\u003dA, iterationId: 9afbaf9b-3be4-4d61-a3c9-de6935faaf44\\\",\\\"ts\\\":1710091344772,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344771,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fra.de.distfiles.macports.org/aspectj/?C\\\\u003dD;O\\\\u003dA, iterationId: 9afbaf9b-3be4-4d61-a3c9-de6935faaf44\\\",\\\"ts\\\":1710091344772,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 221, recordSize: 362, indexRecordBytes: 549433\\\",\\\"ts\\\":1710091344772,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fra.de.distfiles.macports.org/aspectj/?C\\\\u003dD;O\\\\u003dA, indexRecordsCount: 222, indexRecordsBytes: 549795, numRecordsNotCheckpointed: 222, iterationId: 9afbaf9b-3be4-4d61-a3c9-de6935faaf44\\\",\\\"ts\\\":1710091344772,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fra.de.distfiles.macports.org/aspectj/?C\\\\u003dD;O\\\\u003dA, iterationId: 9afbaf9b-3be4-4d61-a3c9-de6935faaf44\\\",\\\"ts\\\":1710091344772,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344772}\\\",\\\"ts\\\":1710091344772,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344772}, latency: 0\\\",\\\"ts\\\":1710091344772,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 9afbaf9b-3be4-4d61-a3c9-de6935faaf44, iterationLatency: 15\\\",\\\"ts\\\":1710091344772,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 2c2c0a77-0273-43b4-835b-a32ba010244e\\\",\\\"ts\\\":1710091344772,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344772}\\\",\\\"ts\\\":1710091344772,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344772}, latency: 0\\\",\\\"ts\\\":1710091344772,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 2c2c0a77-0273-43b4-835b-a32ba010244e\\\",\\\"ts\\\":1710091344772,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 15\\\",\\\"ts\\\":1710091344787,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fra.limited/societe/societe-civile-d-exploitation-et-de-production-de-champagne-eog6, iterationId: 2c2c0a77-0273-43b4-835b-a32ba010244e\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fra.limited/societe/societe-civile-d-exploitation-et-de-production-de-champagne-eog6, iterationId: 2c2c0a77-0273-43b4-835b-a32ba010244e\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344788}\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344788}, latency: 0\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fra.limited/societe/societe-civile-d-exploitation-et-de-production-de-champagne-eog6, iterationId: 2c2c0a77-0273-43b4-835b-a32ba010244e\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fra.limited/societe/societe-civile-d-exploitation-et-de-production-de-champagne-eog6, iterationId: 2c2c0a77-0273-43b4-835b-a32ba010244e\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fra.limited/societe/societe-civile-d-exploitation-et-de-production-de-champagne-eog6, iterationId: 2c2c0a77-0273-43b4-835b-a32ba010244e\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 222, recordSize: 2160, indexRecordBytes: 549795\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fra.limited/societe/societe-civile-d-exploitation-et-de-production-de-champagne-eog6, indexRecordsCount: 223, indexRecordsBytes: 551955, numRecordsNotCheckpointed: 223, iterationId: 2c2c0a77-0273-43b4-835b-a32ba010244e\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fra.limited/societe/societe-civile-d-exploitation-et-de-production-de-champagne-eog6, iterationId: 2c2c0a77-0273-43b4-835b-a32ba010244e\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344788}\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344788}, latency: 0\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 2c2c0a77-0273-43b4-835b-a32ba010244e, iterationLatency: 16\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 40a343d6-e490-4625-a34d-d1e5b6adaad3\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344788}\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344788}, latency: 0\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 40a343d6-e490-4625-a34d-d1e5b6adaad3\\\",\\\"ts\\\":1710091344788,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 15\\\",\\\"ts\\\":1710091344803,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344803,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344803,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fragolosablog.com/slider-3-post-bottom/, iterationId: 40a343d6-e490-4625-a34d-d1e5b6adaad3\\\",\\\"ts\\\":1710091344803,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fragolosablog.com/slider-3-post-bottom/, iterationId: 40a343d6-e490-4625-a34d-d1e5b6adaad3\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344804}\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344804}, latency: 0\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fragolosablog.com/slider-3-post-bottom/, iterationId: 40a343d6-e490-4625-a34d-d1e5b6adaad3\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fragolosablog.com/slider-3-post-bottom/, iterationId: 40a343d6-e490-4625-a34d-d1e5b6adaad3\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fragolosablog.com/slider-3-post-bottom/, iterationId: 40a343d6-e490-4625-a34d-d1e5b6adaad3\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 223, recordSize: 2519, indexRecordBytes: 551955\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fragolosablog.com/slider-3-post-bottom/, indexRecordsCount: 224, indexRecordsBytes: 554474, numRecordsNotCheckpointed: 224, iterationId: 40a343d6-e490-4625-a34d-d1e5b6adaad3\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fragolosablog.com/slider-3-post-bottom/, iterationId: 40a343d6-e490-4625-a34d-d1e5b6adaad3\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344804}\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344804}, latency: 0\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 40a343d6-e490-4625-a34d-d1e5b6adaad3, iterationLatency: 16\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: e12623ee-fdc2-43c2-98f8-e34064849df1\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344804}\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344804}, latency: 0\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: e12623ee-fdc2-43c2-98f8-e34064849df1\\\",\\\"ts\\\":1710091344804,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344816,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344816,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344816,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://france3-regions.blog.francetvinfo.fr/cote-chateaux/2017/05/26/1-minute-1-vignoble-un-succes-daudience-sur-france-televisions.html, iterationId: e12623ee-fdc2-43c2-98f8-e34064849df1\\\",\\\"ts\\\":1710091344816,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://france3-regions.blog.francetvinfo.fr/cote-chateaux/2017/05/26/1-minute-1-vignoble-un-succes-daudience-sur-france-televisions.html, iterationId: e12623ee-fdc2-43c2-98f8-e34064849df1\\\",\\\"ts\\\":1710091344816,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344816,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344816}\\\",\\\"ts\\\":1710091344816,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344816}, latency: 0\\\",\\\"ts\\\":1710091344816,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://france3-regions.blog.francetvinfo.fr/cote-chateaux/2017/05/26/1-minute-1-vignoble-un-succes-daudience-sur-france-televisions.html, iterationId: e12623ee-fdc2-43c2-98f8-e34064849df1\\\",\\\"ts\\\":1710091344816,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://france3-regions.blog.francetvinfo.fr/cote-chateaux/2017/05/26/1-minute-1-vignoble-un-succes-daudience-sur-france-televisions.html, iterationId: e12623ee-fdc2-43c2-98f8-e34064849df1\\\",\\\"ts\\\":1710091344816,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://france3-regions.blog.francetvinfo.fr/cote-chateaux/2017/05/26/1-minute-1-vignoble-un-succes-daudience-sur-france-televisions.html, iterationId: e12623ee-fdc2-43c2-98f8-e34064849df1\\\",\\\"ts\\\":1710091344817,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 224, recordSize: 5731, indexRecordBytes: 554474\\\",\\\"ts\\\":1710091344817,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://france3-regions.blog.francetvinfo.fr/cote-chateaux/2017/05/26/1-minute-1-vignoble-un-succes-daudience-sur-france-televisions.html, indexRecordsCount: 225, indexRecordsBytes: 560205, numRecordsNotCheckpointed: 225, iterationId: e12623ee-fdc2-43c2-98f8-e34064849df1\\\",\\\"ts\\\":1710091344817,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://france3-regions.blog.francetvinfo.fr/cote-chateaux/2017/05/26/1-minute-1-vignoble-un-succes-daudience-sur-france-televisions.html, iterationId: e12623ee-fdc2-43c2-98f8-e34064849df1\\\",\\\"ts\\\":1710091344817,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344817}\\\",\\\"ts\\\":1710091344817,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344817}, latency: 0\\\",\\\"ts\\\":1710091344817,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: e12623ee-fdc2-43c2-98f8-e34064849df1, iterationLatency: 13\\\",\\\"ts\\\":1710091344817,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: bc616fc4-eb74-459b-aca0-ee4114ba762f\\\",\\\"ts\\\":1710091344817,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344817}\\\",\\\"ts\\\":1710091344817,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344817}, latency: 0\\\",\\\"ts\\\":1710091344817,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: bc616fc4-eb74-459b-aca0-ee4114ba762f\\\",\\\"ts\\\":1710091344817,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 13\\\",\\\"ts\\\":1710091344829,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344829,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344829,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://france3-regions.blog.francetvinfo.fr/toulouse-hors-champ/category/politique, iterationId: bc616fc4-eb74-459b-aca0-ee4114ba762f\\\",\\\"ts\\\":1710091344829,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://france3-regions.blog.francetvinfo.fr/toulouse-hors-champ/category/politique, iterationId: bc616fc4-eb74-459b-aca0-ee4114ba762f\\\",\\\"ts\\\":1710091344829,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344829,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344829}\\\",\\\"ts\\\":1710091344829,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344829}, latency: 0\\\",\\\"ts\\\":1710091344829,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://france3-regions.blog.francetvinfo.fr/toulouse-hors-champ/category/politique, iterationId: bc616fc4-eb74-459b-aca0-ee4114ba762f\\\",\\\"ts\\\":1710091344829,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://france3-regions.blog.francetvinfo.fr/toulouse-hors-champ/category/politique, iterationId: bc616fc4-eb74-459b-aca0-ee4114ba762f\\\",\\\"ts\\\":1710091344829,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://france3-regions.blog.francetvinfo.fr/toulouse-hors-champ/category/politique, iterationId: bc616fc4-eb74-459b-aca0-ee4114ba762f\\\",\\\"ts\\\":1710091344830,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 225, recordSize: 2624, indexRecordBytes: 560205\\\",\\\"ts\\\":1710091344830,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://france3-regions.blog.francetvinfo.fr/toulouse-hors-champ/category/politique, indexRecordsCount: 226, indexRecordsBytes: 562829, numRecordsNotCheckpointed: 226, iterationId: bc616fc4-eb74-459b-aca0-ee4114ba762f\\\",\\\"ts\\\":1710091344830,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://france3-regions.blog.francetvinfo.fr/toulouse-hors-champ/category/politique, iterationId: bc616fc4-eb74-459b-aca0-ee4114ba762f\\\",\\\"ts\\\":1710091344830,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344830}\\\",\\\"ts\\\":1710091344830,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344830}, latency: 0\\\",\\\"ts\\\":1710091344830,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: bc616fc4-eb74-459b-aca0-ee4114ba762f, iterationLatency: 13\\\",\\\"ts\\\":1710091344830,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 2e08f0ad-8935-4e68-85d0-574705fb237f\\\",\\\"ts\\\":1710091344830,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344830}\\\",\\\"ts\\\":1710091344830,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344830}, latency: 0\\\",\\\"ts\\\":1710091344830,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 2e08f0ad-8935-4e68-85d0-574705fb237f\\\",\\\"ts\\\":1710091344830,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 19\\\",\\\"ts\\\":1710091344848,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344848,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344848,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://francepasion.com/categoria-producto/frescos/comida-espanola, iterationId: 2e08f0ad-8935-4e68-85d0-574705fb237f\\\",\\\"ts\\\":1710091344848,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://francepasion.com/categoria-producto/frescos/comida-espanola, iterationId: 2e08f0ad-8935-4e68-85d0-574705fb237f\\\",\\\"ts\\\":1710091344848,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344848,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344848}\\\",\\\"ts\\\":1710091344848,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344848}, latency: 0\\\",\\\"ts\\\":1710091344848,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://francepasion.com/categoria-producto/frescos/comida-espanola, iterationId: 2e08f0ad-8935-4e68-85d0-574705fb237f\\\",\\\"ts\\\":1710091344848,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://francepasion.com/categoria-producto/frescos/comida-espanola, iterationId: 2e08f0ad-8935-4e68-85d0-574705fb237f\\\",\\\"ts\\\":1710091344848,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://francepasion.com/categoria-producto/frescos/comida-espanola, iterationId: 2e08f0ad-8935-4e68-85d0-574705fb237f\\\",\\\"ts\\\":1710091344849,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 226, recordSize: 1613, indexRecordBytes: 562829\\\",\\\"ts\\\":1710091344849,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://francepasion.com/categoria-producto/frescos/comida-espanola, indexRecordsCount: 227, indexRecordsBytes: 564442, numRecordsNotCheckpointed: 227, iterationId: 2e08f0ad-8935-4e68-85d0-574705fb237f\\\",\\\"ts\\\":1710091344849,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://francepasion.com/categoria-producto/frescos/comida-espanola, iterationId: 2e08f0ad-8935-4e68-85d0-574705fb237f\\\",\\\"ts\\\":1710091344849,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344849}\\\",\\\"ts\\\":1710091344849,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344849}, latency: 0\\\",\\\"ts\\\":1710091344849,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 2e08f0ad-8935-4e68-85d0-574705fb237f, iterationLatency: 19\\\",\\\"ts\\\":1710091344849,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: ab02c755-4a5a-432f-9d90-bb8f30479bc6\\\",\\\"ts\\\":1710091344849,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344849}\\\",\\\"ts\\\":1710091344849,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344849}, latency: 0\\\",\\\"ts\\\":1710091344849,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: ab02c755-4a5a-432f-9d90-bb8f30479bc6\\\",\\\"ts\\\":1710091344849,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 9\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://franceverif.fr/fr/site/hellostickers.fr, iterationId: ab02c755-4a5a-432f-9d90-bb8f30479bc6\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://franceverif.fr/fr/site/hellostickers.fr, iterationId: ab02c755-4a5a-432f-9d90-bb8f30479bc6\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344858}\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344858}, latency: 0\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://franceverif.fr/fr/site/hellostickers.fr, iterationId: ab02c755-4a5a-432f-9d90-bb8f30479bc6\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://franceverif.fr/fr/site/hellostickers.fr, iterationId: ab02c755-4a5a-432f-9d90-bb8f30479bc6\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://franceverif.fr/fr/site/hellostickers.fr, iterationId: ab02c755-4a5a-432f-9d90-bb8f30479bc6\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 227, recordSize: 1142, indexRecordBytes: 564442\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://franceverif.fr/fr/site/hellostickers.fr, indexRecordsCount: 228, indexRecordsBytes: 565584, numRecordsNotCheckpointed: 228, iterationId: ab02c755-4a5a-432f-9d90-bb8f30479bc6\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://franceverif.fr/fr/site/hellostickers.fr, iterationId: ab02c755-4a5a-432f-9d90-bb8f30479bc6\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344858}\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344858}, latency: 0\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: ab02c755-4a5a-432f-9d90-bb8f30479bc6, iterationLatency: 9\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 959c1f6f-6799-4055-9bbf-f1644c918c93\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344858}\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344858}, latency: 0\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 959c1f6f-6799-4055-9bbf-f1644c918c93\\\",\\\"ts\\\":1710091344858,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 14\\\",\\\"ts\\\":1710091344872,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://franceverif.fr/fr/site/top5meilleurmatelas.fr, iterationId: 959c1f6f-6799-4055-9bbf-f1644c918c93\\\",\\\"ts\\\":1710091344872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://franceverif.fr/fr/site/top5meilleurmatelas.fr, iterationId: 959c1f6f-6799-4055-9bbf-f1644c918c93\\\",\\\"ts\\\":1710091344872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344872}\\\",\\\"ts\\\":1710091344872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344872,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344872}, latency: 0\\\",\\\"ts\\\":1710091344872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://franceverif.fr/fr/site/top5meilleurmatelas.fr, iterationId: 959c1f6f-6799-4055-9bbf-f1644c918c93\\\",\\\"ts\\\":1710091344872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://franceverif.fr/fr/site/top5meilleurmatelas.fr, iterationId: 959c1f6f-6799-4055-9bbf-f1644c918c93\\\",\\\"ts\\\":1710091344872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://franceverif.fr/fr/site/top5meilleurmatelas.fr, iterationId: 959c1f6f-6799-4055-9bbf-f1644c918c93\\\",\\\"ts\\\":1710091344872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 228, recordSize: 1099, indexRecordBytes: 565584\\\",\\\"ts\\\":1710091344872,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://franceverif.fr/fr/site/top5meilleurmatelas.fr, indexRecordsCount: 229, indexRecordsBytes: 566683, numRecordsNotCheckpointed: 229, iterationId: 959c1f6f-6799-4055-9bbf-f1644c918c93\\\",\\\"ts\\\":1710091344873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://franceverif.fr/fr/site/top5meilleurmatelas.fr, iterationId: 959c1f6f-6799-4055-9bbf-f1644c918c93\\\",\\\"ts\\\":1710091344873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344873}\\\",\\\"ts\\\":1710091344873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344873}, latency: 0\\\",\\\"ts\\\":1710091344873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 959c1f6f-6799-4055-9bbf-f1644c918c93, iterationLatency: 15\\\",\\\"ts\\\":1710091344873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: dea286f4-03d0-42d7-b60b-23d3960c998a\\\",\\\"ts\\\":1710091344873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344873}\\\",\\\"ts\\\":1710091344873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344873}, latency: 0\\\",\\\"ts\\\":1710091344873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: dea286f4-03d0-42d7-b60b-23d3960c998a\\\",\\\"ts\\\":1710091344873,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344884,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://franceverif.fr/fr/site/univers-shop.net, iterationId: dea286f4-03d0-42d7-b60b-23d3960c998a\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://franceverif.fr/fr/site/univers-shop.net, iterationId: dea286f4-03d0-42d7-b60b-23d3960c998a\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344885}\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344885}, latency: 0\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://franceverif.fr/fr/site/univers-shop.net, iterationId: dea286f4-03d0-42d7-b60b-23d3960c998a\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://franceverif.fr/fr/site/univers-shop.net, iterationId: dea286f4-03d0-42d7-b60b-23d3960c998a\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://franceverif.fr/fr/site/univers-shop.net, iterationId: dea286f4-03d0-42d7-b60b-23d3960c998a\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 229, recordSize: 1083, indexRecordBytes: 566683\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://franceverif.fr/fr/site/univers-shop.net, indexRecordsCount: 230, indexRecordsBytes: 567766, numRecordsNotCheckpointed: 230, iterationId: dea286f4-03d0-42d7-b60b-23d3960c998a\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://franceverif.fr/fr/site/univers-shop.net, iterationId: dea286f4-03d0-42d7-b60b-23d3960c998a\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344885}\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344885}, latency: 0\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: dea286f4-03d0-42d7-b60b-23d3960c998a, iterationLatency: 12\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: c6348a02-6223-41bf-8e69-63a46d368046\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344885}\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344885}, latency: 0\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: c6348a02-6223-41bf-8e69-63a46d368046\\\",\\\"ts\\\":1710091344885,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 10\\\",\\\"ts\\\":1710091344895,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344895,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344895,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://franceverif.fr/fr/site/vdberk.fr, iterationId: c6348a02-6223-41bf-8e69-63a46d368046\\\",\\\"ts\\\":1710091344895,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://franceverif.fr/fr/site/vdberk.fr, iterationId: c6348a02-6223-41bf-8e69-63a46d368046\\\",\\\"ts\\\":1710091344895,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344895}\\\",\\\"ts\\\":1710091344895,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344895}, latency: 0\\\",\\\"ts\\\":1710091344895,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://franceverif.fr/fr/site/vdberk.fr, iterationId: c6348a02-6223-41bf-8e69-63a46d368046\\\",\\\"ts\\\":1710091344896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://franceverif.fr/fr/site/vdberk.fr, iterationId: c6348a02-6223-41bf-8e69-63a46d368046\\\",\\\"ts\\\":1710091344896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://franceverif.fr/fr/site/vdberk.fr, iterationId: c6348a02-6223-41bf-8e69-63a46d368046\\\",\\\"ts\\\":1710091344896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 230, recordSize: 1082, indexRecordBytes: 567766\\\",\\\"ts\\\":1710091344896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://franceverif.fr/fr/site/vdberk.fr, indexRecordsCount: 231, indexRecordsBytes: 568848, numRecordsNotCheckpointed: 231, iterationId: c6348a02-6223-41bf-8e69-63a46d368046\\\",\\\"ts\\\":1710091344896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344896,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://franceverif.fr/fr/site/vdberk.fr, iterationId: c6348a02-6223-41bf-8e69-63a46d368046\\\",\\\"ts\\\":1710091344896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344896}\\\",\\\"ts\\\":1710091344896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344896}, latency: 0\\\",\\\"ts\\\":1710091344896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: c6348a02-6223-41bf-8e69-63a46d368046, iterationLatency: 11\\\",\\\"ts\\\":1710091344896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 0b30a2ff-eef9-4994-8af7-3eec36982aaa\\\",\\\"ts\\\":1710091344896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344896}\\\",\\\"ts\\\":1710091344896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344896}, latency: 0\\\",\\\"ts\\\":1710091344896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 0b30a2ff-eef9-4994-8af7-3eec36982aaa\\\",\\\"ts\\\":1710091344896,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 15\\\",\\\"ts\\\":1710091344911,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344911,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344911,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://franchiseunit.com/leveraging-ai-for-franchise-referral-programs-increase-loyalty/, iterationId: 0b30a2ff-eef9-4994-8af7-3eec36982aaa\\\",\\\"ts\\\":1710091344911,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://franchiseunit.com/leveraging-ai-for-franchise-referral-programs-increase-loyalty/, iterationId: 0b30a2ff-eef9-4994-8af7-3eec36982aaa\\\",\\\"ts\\\":1710091344911,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344911}\\\",\\\"ts\\\":1710091344911,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344911}, latency: 0\\\",\\\"ts\\\":1710091344911,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://franchiseunit.com/leveraging-ai-for-franchise-referral-programs-increase-loyalty/, iterationId: 0b30a2ff-eef9-4994-8af7-3eec36982aaa\\\",\\\"ts\\\":1710091344911,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344911,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://franchiseunit.com/leveraging-ai-for-franchise-referral-programs-increase-loyalty/, iterationId: 0b30a2ff-eef9-4994-8af7-3eec36982aaa\\\",\\\"ts\\\":1710091344911,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://franchiseunit.com/leveraging-ai-for-franchise-referral-programs-increase-loyalty/, iterationId: 0b30a2ff-eef9-4994-8af7-3eec36982aaa\\\",\\\"ts\\\":1710091344913,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 231, recordSize: 7724, indexRecordBytes: 568848\\\",\\\"ts\\\":1710091344913,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://franchiseunit.com/leveraging-ai-for-franchise-referral-programs-increase-loyalty/, indexRecordsCount: 232, indexRecordsBytes: 576572, numRecordsNotCheckpointed: 232, iterationId: 0b30a2ff-eef9-4994-8af7-3eec36982aaa\\\",\\\"ts\\\":1710091344913,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://franchiseunit.com/leveraging-ai-for-franchise-referral-programs-increase-loyalty/, iterationId: 0b30a2ff-eef9-4994-8af7-3eec36982aaa\\\",\\\"ts\\\":1710091344913,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344913}\\\",\\\"ts\\\":1710091344913,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344913}, latency: 0\\\",\\\"ts\\\":1710091344913,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 0b30a2ff-eef9-4994-8af7-3eec36982aaa, iterationLatency: 17\\\",\\\"ts\\\":1710091344913,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: c95bda49-c2e5-4b81-92c4-3d483a703138\\\",\\\"ts\\\":1710091344913,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344913}\\\",\\\"ts\\\":1710091344913,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344913}, latency: 0\\\",\\\"ts\\\":1710091344913,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: c95bda49-c2e5-4b81-92c4-3d483a703138\\\",\\\"ts\\\":1710091344913,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 14\\\",\\\"ts\\\":1710091344925,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344925,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344925,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://franciscocollmorales.com/iva-vehiculos/, iterationId: c95bda49-c2e5-4b81-92c4-3d483a703138\\\",\\\"ts\\\":1710091344925,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://franciscocollmorales.com/iva-vehiculos/, iterationId: c95bda49-c2e5-4b81-92c4-3d483a703138\\\",\\\"ts\\\":1710091344925,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344925}\\\",\\\"ts\\\":1710091344925,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344925,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344925}, latency: 0\\\",\\\"ts\\\":1710091344925,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://franciscocollmorales.com/iva-vehiculos/, iterationId: c95bda49-c2e5-4b81-92c4-3d483a703138\\\",\\\"ts\\\":1710091344926,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://franciscocollmorales.com/iva-vehiculos/, iterationId: c95bda49-c2e5-4b81-92c4-3d483a703138\\\",\\\"ts\\\":1710091344926,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://franciscocollmorales.com/iva-vehiculos/, iterationId: c95bda49-c2e5-4b81-92c4-3d483a703138\\\",\\\"ts\\\":1710091344926,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 232, recordSize: 4070, indexRecordBytes: 576572\\\",\\\"ts\\\":1710091344926,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://franciscocollmorales.com/iva-vehiculos/, indexRecordsCount: 233, indexRecordsBytes: 580642, numRecordsNotCheckpointed: 233, iterationId: c95bda49-c2e5-4b81-92c4-3d483a703138\\\",\\\"ts\\\":1710091344926,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://franciscocollmorales.com/iva-vehiculos/, iterationId: c95bda49-c2e5-4b81-92c4-3d483a703138\\\",\\\"ts\\\":1710091344926,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344926}\\\",\\\"ts\\\":1710091344926,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344926}, latency: 0\\\",\\\"ts\\\":1710091344926,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: c95bda49-c2e5-4b81-92c4-3d483a703138, iterationLatency: 13\\\",\\\"ts\\\":1710091344926,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: da6da72c-6091-4e00-9d7e-86c88ade38ba\\\",\\\"ts\\\":1710091344926,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344926}\\\",\\\"ts\\\":1710091344926,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344926}, latency: 0\\\",\\\"ts\\\":1710091344926,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: da6da72c-6091-4e00-9d7e-86c88ade38ba\\\",\\\"ts\\\":1710091344926,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://franckperrogon.com/fr/portfolio-11186-lets-danse, iterationId: da6da72c-6091-4e00-9d7e-86c88ade38ba\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://franckperrogon.com/fr/portfolio-11186-lets-danse, iterationId: da6da72c-6091-4e00-9d7e-86c88ade38ba\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344939}\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344939}, latency: 0\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://franckperrogon.com/fr/portfolio-11186-lets-danse, iterationId: da6da72c-6091-4e00-9d7e-86c88ade38ba\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://franckperrogon.com/fr/portfolio-11186-lets-danse, iterationId: da6da72c-6091-4e00-9d7e-86c88ade38ba\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://franckperrogon.com/fr/portfolio-11186-lets-danse, iterationId: da6da72c-6091-4e00-9d7e-86c88ade38ba\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 233, recordSize: 533, indexRecordBytes: 580642\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://franckperrogon.com/fr/portfolio-11186-lets-danse, indexRecordsCount: 234, indexRecordsBytes: 581175, numRecordsNotCheckpointed: 234, iterationId: da6da72c-6091-4e00-9d7e-86c88ade38ba\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://franckperrogon.com/fr/portfolio-11186-lets-danse, iterationId: da6da72c-6091-4e00-9d7e-86c88ade38ba\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344939}\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344939}, latency: 0\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: da6da72c-6091-4e00-9d7e-86c88ade38ba, iterationLatency: 13\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 49b08f26-d18b-4a84-96c9-89557d91696e\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344939}\\\",\\\"ts\\\":1710091344939,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344939}, latency: 0\\\",\\\"ts\\\":1710091344940,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 49b08f26-d18b-4a84-96c9-89557d91696e\\\",\\\"ts\\\":1710091344940,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344940,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 13\\\",\\\"ts\\\":1710091344954,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344954,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344954,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://franklinsedoc.com/author/admin/page/3/, iterationId: 49b08f26-d18b-4a84-96c9-89557d91696e\\\",\\\"ts\\\":1710091344954,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://franklinsedoc.com/author/admin/page/3/, iterationId: 49b08f26-d18b-4a84-96c9-89557d91696e\\\",\\\"ts\\\":1710091344954,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344954}\\\",\\\"ts\\\":1710091344954,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344954}, latency: 0\\\",\\\"ts\\\":1710091344955,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://franklinsedoc.com/author/admin/page/3/, iterationId: 49b08f26-d18b-4a84-96c9-89557d91696e\\\",\\\"ts\\\":1710091344955,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://franklinsedoc.com/author/admin/page/3/, iterationId: 49b08f26-d18b-4a84-96c9-89557d91696e\\\",\\\"ts\\\":1710091344955,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344955,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://franklinsedoc.com/author/admin/page/3/, iterationId: 49b08f26-d18b-4a84-96c9-89557d91696e\\\",\\\"ts\\\":1710091344957,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 234, recordSize: 16398, indexRecordBytes: 581175\\\",\\\"ts\\\":1710091344957,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://franklinsedoc.com/author/admin/page/3/, indexRecordsCount: 235, indexRecordsBytes: 597573, numRecordsNotCheckpointed: 235, iterationId: 49b08f26-d18b-4a84-96c9-89557d91696e\\\",\\\"ts\\\":1710091344957,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://franklinsedoc.com/author/admin/page/3/, iterationId: 49b08f26-d18b-4a84-96c9-89557d91696e\\\",\\\"ts\\\":1710091344957,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344957}\\\",\\\"ts\\\":1710091344957,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344957}, latency: 0\\\",\\\"ts\\\":1710091344957,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 49b08f26-d18b-4a84-96c9-89557d91696e, iterationLatency: 18\\\",\\\"ts\\\":1710091344957,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 4402dcff-521d-4ad4-956d-a8c5f0f9e84c\\\",\\\"ts\\\":1710091344957,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344957}\\\",\\\"ts\\\":1710091344957,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344957}, latency: 0\\\",\\\"ts\\\":1710091344957,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 4402dcff-521d-4ad4-956d-a8c5f0f9e84c\\\",\\\"ts\\\":1710091344957,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 19\\\",\\\"ts\\\":1710091344974,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344974,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344974,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://franklywearing.com/creator-products?page\\\\u003d13\\\\u0026product_id\\\\u003d83\\\\u0026q\\\\u003dFeminist\\\\u0026sort_by\\\\u003dfinal_rating, iterationId: 4402dcff-521d-4ad4-956d-a8c5f0f9e84c\\\",\\\"ts\\\":1710091344974,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://franklywearing.com/creator-products?page\\\\u003d13\\\\u0026product_id\\\\u003d83\\\\u0026q\\\\u003dFeminist\\\\u0026sort_by\\\\u003dfinal_rating, iterationId: 4402dcff-521d-4ad4-956d-a8c5f0f9e84c\\\",\\\"ts\\\":1710091344974,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344974,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344974}\\\",\\\"ts\\\":1710091344974,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344974}, latency: 0\\\",\\\"ts\\\":1710091344975,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://franklywearing.com/creator-products?page\\\\u003d13\\\\u0026product_id\\\\u003d83\\\\u0026q\\\\u003dFeminist\\\\u0026sort_by\\\\u003dfinal_rating, iterationId: 4402dcff-521d-4ad4-956d-a8c5f0f9e84c\\\",\\\"ts\\\":1710091344975,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://franklywearing.com/creator-products?page\\\\u003d13\\\\u0026product_id\\\\u003d83\\\\u0026q\\\\u003dFeminist\\\\u0026sort_by\\\\u003dfinal_rating, iterationId: 4402dcff-521d-4ad4-956d-a8c5f0f9e84c\\\",\\\"ts\\\":1710091344975,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://franklywearing.com/creator-products?page\\\\u003d13\\\\u0026product_id\\\\u003d83\\\\u0026q\\\\u003dFeminist\\\\u0026sort_by\\\\u003dfinal_rating, iterationId: 4402dcff-521d-4ad4-956d-a8c5f0f9e84c\\\",\\\"ts\\\":1710091344975,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 235, recordSize: 3997, indexRecordBytes: 597573\\\",\\\"ts\\\":1710091344975,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://franklywearing.com/creator-products?page\\\\u003d13\\\\u0026product_id\\\\u003d83\\\\u0026q\\\\u003dFeminist\\\\u0026sort_by\\\\u003dfinal_rating, indexRecordsCount: 236, indexRecordsBytes: 601570, numRecordsNotCheckpointed: 236, iterationId: 4402dcff-521d-4ad4-956d-a8c5f0f9e84c\\\",\\\"ts\\\":1710091344975,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://franklywearing.com/creator-products?page\\\\u003d13\\\\u0026product_id\\\\u003d83\\\\u0026q\\\\u003dFeminist\\\\u0026sort_by\\\\u003dfinal_rating, iterationId: 4402dcff-521d-4ad4-956d-a8c5f0f9e84c\\\",\\\"ts\\\":1710091344975,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344975}\\\",\\\"ts\\\":1710091344975,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344975}, latency: 0\\\",\\\"ts\\\":1710091344975,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 4402dcff-521d-4ad4-956d-a8c5f0f9e84c, iterationLatency: 18\\\",\\\"ts\\\":1710091344975,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 4b4cfe00-aff1-4d70-940d-31920615a82d\\\",\\\"ts\\\":1710091344975,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344975}\\\",\\\"ts\\\":1710091344975,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344975}, latency: 0\\\",\\\"ts\\\":1710091344975,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 4b4cfe00-aff1-4d70-940d-31920615a82d\\\",\\\"ts\\\":1710091344975,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 15\\\",\\\"ts\\\":1710091344990,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091344990,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091344990,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://freaksgalore.com/lesbian-lovers/, iterationId: 4b4cfe00-aff1-4d70-940d-31920615a82d\\\",\\\"ts\\\":1710091344990,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://freaksgalore.com/lesbian-lovers/, iterationId: 4b4cfe00-aff1-4d70-940d-31920615a82d\\\",\\\"ts\\\":1710091344990,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344990}\\\",\\\"ts\\\":1710091344990,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344990}, latency: 0\\\",\\\"ts\\\":1710091344991,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://freaksgalore.com/lesbian-lovers/, iterationId: 4b4cfe00-aff1-4d70-940d-31920615a82d\\\",\\\"ts\\\":1710091344991,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://freaksgalore.com/lesbian-lovers/, iterationId: 4b4cfe00-aff1-4d70-940d-31920615a82d\\\",\\\"ts\\\":1710091344991,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091344991,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://freaksgalore.com/lesbian-lovers/, iterationId: 4b4cfe00-aff1-4d70-940d-31920615a82d\\\",\\\"ts\\\":1710091344991,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 236, recordSize: 1019, indexRecordBytes: 601570\\\",\\\"ts\\\":1710091344991,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://freaksgalore.com/lesbian-lovers/, indexRecordsCount: 237, indexRecordsBytes: 602589, numRecordsNotCheckpointed: 237, iterationId: 4b4cfe00-aff1-4d70-940d-31920615a82d\\\",\\\"ts\\\":1710091344991,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://freaksgalore.com/lesbian-lovers/, iterationId: 4b4cfe00-aff1-4d70-940d-31920615a82d\\\",\\\"ts\\\":1710091344991,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344991}\\\",\\\"ts\\\":1710091344991,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344991}, latency: 0\\\",\\\"ts\\\":1710091344991,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 4b4cfe00-aff1-4d70-940d-31920615a82d, iterationLatency: 16\\\",\\\"ts\\\":1710091344991,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 7ae61e3e-6a72-4a98-9c09-5378056a973f\\\",\\\"ts\\\":1710091344991,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344991}\\\",\\\"ts\\\":1710091344991,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091344991}, latency: 0\\\",\\\"ts\\\":1710091344991,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:24 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 7ae61e3e-6a72-4a98-9c09-5378056a973f\\\",\\\"ts\\\":1710091344991,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 24\\\",\\\"ts\\\":1710091345015,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091345015,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091345015,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://freddyduclercexpedicao.com.br/suplementacao-de-montanha/, iterationId: 7ae61e3e-6a72-4a98-9c09-5378056a973f\\\",\\\"ts\\\":1710091345015,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://freddyduclercexpedicao.com.br/suplementacao-de-montanha/, iterationId: 7ae61e3e-6a72-4a98-9c09-5378056a973f\\\",\\\"ts\\\":1710091345016,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345016}\\\",\\\"ts\\\":1710091345016,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091345016,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345016}, latency: 0\\\",\\\"ts\\\":1710091345016,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://freddyduclercexpedicao.com.br/suplementacao-de-montanha/, iterationId: 7ae61e3e-6a72-4a98-9c09-5378056a973f\\\",\\\"ts\\\":1710091345016,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://freddyduclercexpedicao.com.br/suplementacao-de-montanha/, iterationId: 7ae61e3e-6a72-4a98-9c09-5378056a973f\\\",\\\"ts\\\":1710091345016,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://freddyduclercexpedicao.com.br/suplementacao-de-montanha/, iterationId: 7ae61e3e-6a72-4a98-9c09-5378056a973f\\\",\\\"ts\\\":1710091345016,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 237, recordSize: 3932, indexRecordBytes: 602589\\\",\\\"ts\\\":1710091345016,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://freddyduclercexpedicao.com.br/suplementacao-de-montanha/, indexRecordsCount: 238, indexRecordsBytes: 606521, numRecordsNotCheckpointed: 238, iterationId: 7ae61e3e-6a72-4a98-9c09-5378056a973f\\\",\\\"ts\\\":1710091345016,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://freddyduclercexpedicao.com.br/suplementacao-de-montanha/, iterationId: 7ae61e3e-6a72-4a98-9c09-5378056a973f\\\",\\\"ts\\\":1710091345016,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345016}\\\",\\\"ts\\\":1710091345016,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345016}, latency: 0\\\",\\\"ts\\\":1710091345016,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: 7ae61e3e-6a72-4a98-9c09-5378056a973f, iterationLatency: 25\\\",\\\"ts\\\":1710091345016,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: b3dc03e0-fd33-469e-b543-d973d5bfdc39\\\",\\\"ts\\\":1710091345016,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345017}\\\",\\\"ts\\\":1710091345017,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345017}, latency: 0\\\",\\\"ts\\\":1710091345017,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: b3dc03e0-fd33-469e-b543-d973d5bfdc39\\\",\\\"ts\\\":1710091345017,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 18\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fredericsage.com/?attachment_id\\\\u003d31071, iterationId: b3dc03e0-fd33-469e-b543-d973d5bfdc39\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fredericsage.com/?attachment_id\\\\u003d31071, iterationId: b3dc03e0-fd33-469e-b543-d973d5bfdc39\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345035}\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345035}, latency: 0\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fredericsage.com/?attachment_id\\\\u003d31071, iterationId: b3dc03e0-fd33-469e-b543-d973d5bfdc39\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fredericsage.com/?attachment_id\\\\u003d31071, iterationId: b3dc03e0-fd33-469e-b543-d973d5bfdc39\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fredericsage.com/?attachment_id\\\\u003d31071, iterationId: b3dc03e0-fd33-469e-b543-d973d5bfdc39\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 238, recordSize: 956, indexRecordBytes: 606521\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fredericsage.com/?attachment_id\\\\u003d31071, indexRecordsCount: 239, indexRecordsBytes: 607477, numRecordsNotCheckpointed: 239, iterationId: b3dc03e0-fd33-469e-b543-d973d5bfdc39\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fredericsage.com/?attachment_id\\\\u003d31071, iterationId: b3dc03e0-fd33-469e-b543-d973d5bfdc39\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345035}\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345035}, latency: 0\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: b3dc03e0-fd33-469e-b543-d973d5bfdc39, iterationLatency: 19\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: e89dbdb4-72f2-4e1d-af1f-87d50b485f26\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345035}\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345035}, latency: 0\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: e89dbdb4-72f2-4e1d-af1f-87d50b485f26\\\",\\\"ts\\\":1710091345035,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 11\\\",\\\"ts\\\":1710091345046,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091345046,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091345046,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://fredmans.com/sv/mido-multifort-klockor/mido-multifort-automatisk-svart-orange-laederband-herrklocka-m0054303605180, iterationId: e89dbdb4-72f2-4e1d-af1f-87d50b485f26\\\",\\\"ts\\\":1710091345046,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://fredmans.com/sv/mido-multifort-klockor/mido-multifort-automatisk-svart-orange-laederband-herrklocka-m0054303605180, iterationId: e89dbdb4-72f2-4e1d-af1f-87d50b485f26\\\",\\\"ts\\\":1710091345046,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345046}\\\",\\\"ts\\\":1710091345046,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091345046,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345046}, latency: 0\\\",\\\"ts\\\":1710091345046,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://fredmans.com/sv/mido-multifort-klockor/mido-multifort-automatisk-svart-orange-laederband-herrklocka-m0054303605180, iterationId: e89dbdb4-72f2-4e1d-af1f-87d50b485f26\\\",\\\"ts\\\":1710091345046,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://fredmans.com/sv/mido-multifort-klockor/mido-multifort-automatisk-svart-orange-laederband-herrklocka-m0054303605180, iterationId: e89dbdb4-72f2-4e1d-af1f-87d50b485f26\\\",\\\"ts\\\":1710091345046,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://fredmans.com/sv/mido-multifort-klockor/mido-multifort-automatisk-svart-orange-laederband-herrklocka-m0054303605180, iterationId: e89dbdb4-72f2-4e1d-af1f-87d50b485f26\\\",\\\"ts\\\":1710091345047,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 239, recordSize: 3894, indexRecordBytes: 607477\\\",\\\"ts\\\":1710091345047,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://fredmans.com/sv/mido-multifort-klockor/mido-multifort-automatisk-svart-orange-laederband-herrklocka-m0054303605180, indexRecordsCount: 240, indexRecordsBytes: 611371, numRecordsNotCheckpointed: 240, iterationId: e89dbdb4-72f2-4e1d-af1f-87d50b485f26\\\",\\\"ts\\\":1710091345047,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://fredmans.com/sv/mido-multifort-klockor/mido-multifort-automatisk-svart-orange-laederband-herrklocka-m0054303605180, iterationId: e89dbdb4-72f2-4e1d-af1f-87d50b485f26\\\",\\\"ts\\\":1710091345047,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345047}\\\",\\\"ts\\\":1710091345047,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345047}, latency: 0\\\",\\\"ts\\\":1710091345047,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: e89dbdb4-72f2-4e1d-af1f-87d50b485f26, iterationLatency: 12\\\",\\\"ts\\\":1710091345047,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: d2b84e5a-cd41-47dd-97c3-04cd5e0495d2\\\",\\\"ts\\\":1710091345047,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345047}\\\",\\\"ts\\\":1710091345047,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345047}, latency: 0\\\",\\\"ts\\\":1710091345047,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: d2b84e5a-cd41-47dd-97c3-04cd5e0495d2\\\",\\\"ts\\\":1710091345047,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 12\\\",\\\"ts\\\":1710091345058,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091345058,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091345058,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://free-4u.com/Colleges/Castleton-VT-Colleges.html, iterationId: d2b84e5a-cd41-47dd-97c3-04cd5e0495d2\\\",\\\"ts\\\":1710091345058,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://free-4u.com/Colleges/Castleton-VT-Colleges.html, iterationId: d2b84e5a-cd41-47dd-97c3-04cd5e0495d2\\\",\\\"ts\\\":1710091345058,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345058}\\\",\\\"ts\\\":1710091345058,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091345058,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345058}, latency: 0\\\",\\\"ts\\\":1710091345059,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://free-4u.com/Colleges/Castleton-VT-Colleges.html, iterationId: d2b84e5a-cd41-47dd-97c3-04cd5e0495d2\\\",\\\"ts\\\":1710091345059,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://free-4u.com/Colleges/Castleton-VT-Colleges.html, iterationId: d2b84e5a-cd41-47dd-97c3-04cd5e0495d2\\\",\\\"ts\\\":1710091345059,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://free-4u.com/Colleges/Castleton-VT-Colleges.html, iterationId: d2b84e5a-cd41-47dd-97c3-04cd5e0495d2\\\",\\\"ts\\\":1710091345059,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 240, recordSize: 2834, indexRecordBytes: 611371\\\",\\\"ts\\\":1710091345059,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://free-4u.com/Colleges/Castleton-VT-Colleges.html, indexRecordsCount: 241, indexRecordsBytes: 614205, numRecordsNotCheckpointed: 241, iterationId: d2b84e5a-cd41-47dd-97c3-04cd5e0495d2\\\",\\\"ts\\\":1710091345059,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - eval taskStopManager post processing - documentId: https://free-4u.com/Colleges/Castleton-VT-Colleges.html, iterationId: d2b84e5a-cd41-47dd-97c3-04cd5e0495d2\\\",\\\"ts\\\":1710091345059,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":927,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345059}\\\",\\\"ts\\\":1710091345059,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345059}, latency: 0\\\",\\\"ts\\\":1710091345059,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - iteration completed - filename: 1ce7998da2da70266a09440a6da19698, iterationId: d2b84e5a-cd41-47dd-97c3-04cd5e0495d2, iterationLatency: 12\\\",\\\"ts\\\":1710091345059,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":935,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - starting loop iteration for next record - iterationId: 6de1762f-ecc2-48e9-b1ab-7bc33518e275\\\",\\\"ts\\\":1710091345059,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":788,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345059}\\\",\\\"ts\\\":1710091345059,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dnull, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345059}, latency: 0\\\",\\\"ts\\\":1710091345059,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polling for next record - iterationId: 6de1762f-ecc2-48e9-b1ab-7bc33518e275\\\",\\\"ts\\\":1710091345059,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":797,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument returned statusCode: 200, apiStatusCode: SUCCESS, errorMessage: null, latency: 10\\\",\\\"ts\\\":1710091345069,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":100,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - enqueuing doc record\\\",\\\"ts\\\":1710091345069,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":122,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeRead - getting next record\\\",\\\"ts\\\":1710091345070,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.ReaderTaskProcessor\\\",\\\"fnm\\\":\\\"ReaderTaskProcessor.java\\\",\\\"lnm\\\":86,\\\"mnm\\\":\\\"executeRead\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - polled document - documentId: https://free-debt-consolidation.net/orange-cove-california.html, iterationId: 6de1762f-ecc2-48e9-b1ab-7bc33518e275\\\",\\\"ts\\\":1710091345070,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":819,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - completed processing reads, eval read result for task stop - documentId: https://free-debt-consolidation.net/orange-cove-california.html, iterationId: 6de1762f-ecc2-48e9-b1ab-7bc33518e275\\\",\\\"ts\\\":1710091345070,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":861,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager called with taskStatusDetails: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345070}\\\",\\\"ts\\\":1710091345070,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":27,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"TaskStopManager.getStopManagerResult returning result: TaskStatusDetails{readConnectorResult\\\\u003dSUCCESS, writeConnectorResult\\\\u003dnull, statusDatetime\\\\u003d1710091345070}, latency: 0\\\",\\\"ts\\\":1710091345070,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.taskstop.TaskStopManager\\\",\\\"fnm\\\":\\\"TaskStopManager.java\\\",\\\"lnm\\\":116,\\\"mnm\\\":\\\"getStopManagerResult\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - read document processed and task stop determined continue - continuing to write - docId: https://free-debt-consolidation.net/orange-cove-california.html, iterationId: 6de1762f-ecc2-48e9-b1ab-7bc33518e275\\\",\\\"ts\\\":1710091345070,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":864,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - readResult is success, getting partitionKey and data bytes for the document - documentId: https://free-debt-consolidation.net/orange-cove-california.html, iterationId: 6de1762f-ecc2-48e9-b1ab-7bc33518e275\\\",\\\"ts\\\":1710091345070,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":872,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"SingleFileParser.parseDocument calling lambdaClient.invokeFunction\\\",\\\"ts\\\":1710091345070,\\\"cnm\\\":\\\"com.resonance.letsdata.database.pythonbridge.PythonBridgeUtils\\\",\\\"fnm\\\":\\\"PythonBridgeUtils.java\\\",\\\"lnm\\\":84,\\\"mnm\\\":\\\"invokePythonBridgeServiceAndGetResponse\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - getting partitionKey and data bytes completed - documentId: https://free-debt-consolidation.net/orange-cove-california.html, iterationId: 6de1762f-ecc2-48e9-b1ab-7bc33518e275\\\",\\\"ts\\\":1710091345070,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":892,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"shouldWriteAndCheckpoint - connectorDestination: KINESIS, indexRecordsCount: 241, recordSize: 2588, indexRecordBytes: 614205\\\",\\\"ts\\\":1710091345070,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.TaskProcessorWriteUtils\\\",\\\"fnm\\\":\\\"TaskProcessorWriteUtils.java\\\",\\\"lnm\\\":56,\\\"mnm\\\":\\\"shouldWriteAndCheckpoint\\\"}\\n\",\n \"{\\\"dt\\\":\\\"Mar 10, 2024 5:22:25 PM\\\",\\\"lvl\\\":\\\"DEBUG\\\",\\\"msg\\\":\\\"executeWrite - Completed processing record - filename: 1ce7998da2da70266a09440a6da19698 targetUri: https://free-debt-consolidation.net/orange-cove-california.html, indexRecordsCount: 242, indexRecordsBytes: 616793, numRecordsNotCheckpointed: 242, iterationId: 6de1762f-ecc2-48e9-b1ab-7bc33518e275\\\",\\\"ts\\\":1710091345070,\\\"cnm\\\":\\\"com.resonance.saas.data.processors.AbstractTaskProcessor\\\",\\\"fnm\\\":\\\"AbstractTaskProcessor.java\\\",\\\"lnm\\\":912,\\\"mnm\\\":\\\"executeWrite\\\"}\\n\"\n ]\n}"}],"_postman_id":"321939d0-de41-41a9-a131-84053a73f542"}],"id":"6ce267fd-70eb-4800-8cfe-35507b8daa8f","description":"

Each task writes its logs to files which essentially become a task's execution trace that is useful in debugging and monitoring. The logs resources supports the following API methods:

logs GET - View the logs for a task.

Logs can be viewed by either specifying a logToken (returned by the tasks/list GET api), or by specifying a taskId and the iteration for which the logs need to be viewed.

\n","_postman_id":"6ce267fd-70eb-4800-8cfe-35507b8daa8f"},{"name":"metrics","item":[{"name":"View Metrics","id":"13b3f57f-31c3-4bf4-ad74-82b8be2102a6","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/metrics?tenantId=tenantId&userId=userId&datasetName=CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20&dashboardName=TaskDetails&iteration=0","description":"

metrics GET

Dataset execution comes with some system defined metrics that can be used to monitor the system's progress and performance so that issues can be debugged and corrective actions can be taken. The system generated metrics by #Let's Data can be viewed by using the metrics GET api.

We've grouped the different metrics into dashboards. By default, we display the DatasetSummary dashboard, dashboardName parameter can be used to view additional dashboards.
The api by default shows the metrics for all iterations (initial run, redrives) of the dataset. Metrics for a specific iteration / datetime can also be viewed.

Input Parameters:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For Example, --userId 078260ed-3124-4de0-8eee-cc5b5025e7ad (TODO - this can be optional, API gets it from token)
datasetName: The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022
dashboardName: [Optional] The metrics dashboard name to get the metrics data. Allowed Values [ DatasetSummary, TaskDetails]. Defaults to DatasetSummary. For example, &dashboardName=TaskDetails
next: [Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved.

The metrics view command has a couple of different ways to optionally filter the returned metrics - lets look at these different filters:

Filter By Iteration:

iteration: [Optional] The dataset tasks are run initially when the dataset is created and initialized. This creates dataset execution metrics and logs - we call this iteration 0. In case there are task errors, the dataset tasks are redriven - this causes another iteration of the dataset execution that emits metrics and logs - we call this iteration 1. By default, the api lists metrics for all iterations of the dataset, paginated due to data size limits. In case the user is interested only in a specific dataset execution iteration, they can specify this via &iteration=iteration_number parameter.
\n
Filter By Datetime:
\n

viewMetricsDatetimeList: [Optional] The dataset json has execution logs structure that has the start and end datetime for each iteration. User's can specify a start datetime and an end datetime from either these execution logs or a different start and end time interval. #Lets Data would query all the metrics in the query time intervals and return the results. For example, to get the metrics for dataset for specific datetimes, specify the datetimes as the following viewMetricDatetimesList json, then url encode this json and specify this as the viewMetricsDatetimeList parameter.

        [\n            {\n                \"startDatetime\":1669389422030,\n                \"endDatetime\":1669390555470\n            },\n            {\n                \"startDatetime\":1669390855470,\n                \"endDatetime\":1669391155470\n            }\n        ]\n        # compacted and url encoded and specified as a parameter\n        &viewMetricsDatetimeList=[{\"startDatetime\":1669389422030,\"endDatetime\":1669390555470},{\"startDatetime\":1669390855470,\"endDatetime\":1669391155470}]\n\n

Output Parameters:

The output is a list of JSON maps that adopts the Charts.js data schema so that the data can be rendered as charts with little modifications. It also has a next token in-case the data size returned is larger than the max allowed return data size.Each JSON map in the list corresponds to an iteration/datetime in the viewdatetimelist. Here is a look at the return schema:

        {\n            \"charts\": [\n                {\n                    \"chartDataList\": {\n                        \"<ChartName>\": {\n                            \"datasets\": [\n                                {\n                                    \"backgroundColor\": \"red\",\n                                    \"borderColor\": \"red\",\n                                    \"data\": [data1ValueTimestamp1, data1ValueTimestamp2, data1ValueTimestamp3, ...],\n                                    \"label\": \"<ChartLabel Y axis>\",\n                                    \"yAxisID\": \"y\"\n                                },\n                                {\n                                    \"backgroundColor\": \"green\",\n                                    \"borderColor\": \"green\",\n                                    \"data\": [data2ValueTimestamp1, data2ValueTimestamp2, data2ValueTimestamp3, ...],\n                                    \"label\": \"<ChartLabel Y1 axis>\",\n                                    \"yAxisID\": \"y1\"\n                                },\n                                ...\n                            ],\n                            \"labels\": [metricTimestamp1, metricTimestamp2, metricTimestamp3, ...]\n                        },\n                        ...\n                    },\n                    \"endDatetime\": Long - timestamp epoch in millis,\n                    \"startDatetime\": Long - timestamp epoch in millis,\n                    \"taskExecutionNumber\": Long - Dataset Execution Iteration\n                },\n                ...    ],\n            next: \"String\"\n        }\n\n

charts: The schema is mostly self-explanatory - Each chart's data is a key value pair with the ChartName as the key and the datasets list that has each series' data. If interested in only the data for the series, look at the labels (the x axis timestamps) and the data (the value of the series at the label timestamps). We currently support the following charts - details of these are in the docs: https://www.letsdata.io/docs#metrics
\n
- DatasetSummary Dashboard:
  - Task Checkpoint Success (%) & Latency (avg)
  - Task Individual Record Latencies (avg) and Number of Samples (count)
  - Task Kinesis Put Retries (%)
  - Task Kinesis Put Volume (sum) & Latency (avg)
  - Task Latency (avg)
  - Task Records Processed (sum)
  - Task S3 Bytes Read (sum) & Kinesis Bytes Written (sum)
  - Task Success (%) & Number of Tasks (sum)
  \n
- TaskDetails Dashboard:
  - Reader:
    - Message Read Latency (avg) & Number of Messages (sum)
    - Reader Enqueue Message latency (avg)
    \n
  - Compute Engine:
    - Message Wait Time in Compute Queue (avg)
    - Compute Queue Message Dequeue Latency (avg)
    - Message Compute Execution Time (avg) & Number of Messages (sum)
    - Compute Invoke Endpoint Latency (avg) and Overhead Latency (avg)
    - Message Enqueue to Writer Queue Latency (avg)
    - Message Total Compute Time (avg) and Number of Messages (sum)
    - Sagemaker Doc Sizes (avg & max)
    \n
  - Writer:
    - Writer Message PreProcessing Latency (avg)
    - Message Wait Time In Write Buffer (avg)
    - Message Write Latency (avg) & Number of Messages (count)
    \n
  - Overall:
    - Message Total Time (avg) & Number of Messages (sum)
    \n
  \n
\n
next: [Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved.
\n

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

Request successfully retrieved the error file. The response body has the error file contents and the error file metadata.

        {\n            \"charts\": [\n                {\n                    ...\n                },\n                ...    ],\n            next: \"...\"\n        }\n\n

400:

viewMetricsDatetimeList should be null when next is specified.

          {\n            \"statusCode\": \"UNSUPPORTED_PARAMETER\",\n            \"message\": \"viewMetricsDatetimeList should be null when next is specified.\"\n          }\n\n

iteration should be null when next is specified.

          {\n            \"statusCode\": \"UNSUPPORTED_PARAMETER\",\n            \"message\": \"iteration should be null when next is specified.\"\n          }\n\n

next should be null when viewMetricsDatetimeList is specified.

          {\n            \"statusCode\": \"UNSUPPORTED_PARAMETER\",\n            \"message\": \"next should be null when viewMetricsDatetimeList is specified.\"\n          }\n\n

iteration should be null when viewMetricsDatetimeList is specified.

          {\n            \"statusCode\": \"UNSUPPORTED_PARAMETER\",\n            \"message\": \"iteration should be null when viewMetricsDatetimeList is specified.\"\n          }\n\n

next should be null when iteration is specified.

          {\n            \"statusCode\": \"UNSUPPORTED_PARAMETER\",\n            \"message\": \"next should be null when iteration is specified.\"\n          }\n\n

viewMetricsDatetimeList should be null when iteration is specified.

          {\n            \"statusCode\": \"UNSUPPORTED_PARAMETER\",\n            \"message\": \"viewMetricsDatetimeList should be null when iteration is specified.\"\n          }\n\n

The task iteration number is invalid (out of bounds).

          {\n            \"statusCode\": \"INVALID_PARAMETER\",\n            \"message\": \"invalid iteration. The task has had %d runs, iteration should be in range [0, %d] (inclusive).\"\n          }\n\n

404:

The dataset for the tenantId, userId and datasetName was not found in the database. An error code and error message is returned in the response JSON.

          {\n            \"statusCode\": \"DATASET_NOT_FOUND\",\n            \"message\": \"Dataset not found in the database.\"\n          }\n\n

The dataset has been deleted. Any metrics should have been deleted as well.

          {\n            \"statusCode\": \"DELETED\",\n            \"message\": \"datasetStatus is DELETED.\"\n          }\n\n

The dataset has been created but has not started processing yet, as such no metrics have yet been created. Wait for initialization to complete before retrying again.

          {\n            \"statusCode\": \"TASKS_NOT_YET_CREATED\",\n            \"message\": \"datasetStatus is CREATED, tasks have not been created yet, hence there are no metrics. Wait for dataset initialization to complete and retry.\"\n          }\n\n

The dataset exists but hasn't been completely initialized yet, as such no metrics have yet been created. Wait for initialization to complete before retrying again.

          {\n            \"statusCode\": \"TASKS_NOT_YET_CREATED\",\n            \"message\": \"datasetStatus is INITIALIZING, tasks have not been created yet, hence there are no metrics. Wait for dataset initialization to complete and retry.\"\n          }\n\n

500:
\n
- An unexpected error has occurred.
  \n
```
                  {\n                  \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n                  \"message\": \"Internal Server Error, please try again later.\"\n                  }\n\n
```
  \n
- In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
  \n
  Creating Charts From Data:
  \n
  (Not the most elegant way but works for now)
  \n
- Save the data as a javascript variable (exampleChartsData) in a js file, lets call it chartdata.js - For example (exampleChartsData in this js file): https://d108vtfcfy7u5c.cloudfront.net/javascript/examplecharts.js
  \n
- Create an html file - reference the following:
  \n
  - jquery:
  - letsdata default js:
  - chart.js:
  - chartdata.js:
  \n
- Create a canvas div
  \n
```
      <div class=&#x27;preserveHtml&#x27; class=&#x27;preserveHtml&#x27; class=&#x27;preserveHtml&#x27; class=&#x27;preserveHtml&#x27; class=\"row\">\n          <canvas id=\"taskLatency\" width=\"100\" height=\"70\"></canvas>\n      </div>\n\n
```
  \n
- Call the javascript function to draw the chart:
  \n
```
      drawChart('taskLatency', exampleChartsData[0].chartDataList[\"Task Latency (avg)\"], \"Task Latency (avg)\");\n\n
```
  \n
  Examples:
  \n
\n

Example 1: View dataset IndexWebCrawlDataDec2022 metrics for all iterations

        GET www.letsdata.io/api/metrics?tenantId=tenantId \\\n            &userId=userId \\\n            &datasetName=IndexWebCrawlDataDec2022\n\n

Example 2: View dataset (IndexWebCrawlDataDec2022) metrics, for iteration 0

        GET www.letsdata.io/api/metrics?tenantId=tenantId \\\n            &userId=userId \\\n            &datasetName=IndexWebCrawlDataDec2022 \\\n            &iteration=0\n\n

Example 3: View dataset IndexWebCrawlDataDec2022's TaskDetails dashboard metrics for iteration 0

        GET www.letsdata.io/api/metrics?tenantId=tenantId \\\n            &userId=userId \\\n            &datasetName=IndexWebCrawlDataDec2022 \\\n            &iteration=0 \\\n            &dashboardName=TaskDetails\n\n

Example 4 get the metrics for dataset for specific datetime

        # viewMetricsDatetimeList json\n        [\n            {\n                \"startDatetime\":1669389422030,\n                \"endDatetime\":1669390555470\n            },\n            {\n                \"startDatetime\":1669390855470,\n                \"endDatetime\":1669391155470\n            }\n        ]\n        # compacted and url encoded and specified as a parameter\n        GET www.letsdata.io/api/metrics?tenantId=tenantId \\\n                &userId=userId \\\n                &datasetName=IndexWebCrawlDataDec2022 \\\n                &viewMetricsDatetimeList=[{\"startDatetime\":1669389422030,\"endDatetime\":1669390555470},{\"startDatetime\":1669390855470,\"endDatetime\":1669391155470}]\n\n

Docs:

You can also learn all about Metrics at: https://www.letsdata.io/docs#metrics

\n","urlObject":{"path":["api","metrics"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

\n","type":"text/plain"},"key":"userId","value":"userId"},{"description":{"content":"

The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022

\n","type":"text/plain"},"key":"datasetName","value":"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20"},{"description":{"content":"

[Optional] The metrics dashboard name to get the metrics data. Allowed Values [ DatasetSummary, TaskDetails]. Defaults to DatasetSummary

\n","type":"text/plain"},"key":"dashboardName","value":"TaskDetails"},{"description":{"content":"

[Optional] The dataset tasks are run initially when the dataset is created and initialized. This creates dataset execution metrics and logs - we call this iteration 0. In case there are task errors, the dataset tasks are redriven - this causes another iteration of the dataset execution that emits metrics and logs - we call this iteration 1. By default, the api lists metrics for all iterations of the dataset, paginated due to data size limits. In case the user is interested only in a specific dataset execution iteration, they can specify this via &iteration=iteration_number parameter.

\n","type":"text/plain"},"key":"iteration","value":"0"},{"disabled":true,"description":{"content":"

\n","type":"text/plain"},"key":"next","value":""},{"disabled":true,"description":{"content":"

[Optional] The dataset json has execution logs structure that has the start and end datetime for each iteration. User's can specify a start datetime and an end datetime from either these execution logs or a different start and end time interval. #Lets Data would query all the metrics in the query time intervals and return the results. For example, to get the metrics for dataset for specific datetimes, specify the datetimes as the following viewMetricDatetimesList json, then url encode this json and specify this as the viewMetricsDatetimeList parameter.

    [\n        {\n            \"startDatetime\":1669389422030,\n            \"endDatetime\":1669390555470\n        },\n        {\n            \"startDatetime\":1669390855470,\n            \"endDatetime\":1669391155470\n        }\n    ]\n\n    # compacted and url encoded and specified as a parameter\n    #&viewMetricsDatetimeList=%5B%7B%22startDatetime%22%3A1669389422030%2C%22endDatetime%22%3A1669390555470%7D%2C%7B%22startDatetime%22%3A1669390855470%2C%22endDatetime%22%3A1669391155470%7D%5D\n

","type":"text/plain"},"key":"viewMetricsDatetimeList","value":"%5B%7B%22startDatetime%22%3A1669389422030%2C%22endDatetime%22%3A1669390555470%7D%2C%7B%22startDatetime%22%3A1669390855470%2C%22endDatetime%22%3A1669391155470%7D%5D"}],"variable":[]}},"response":[{"id":"904077b7-9acd-4068-9435-be15250bf53b","name":"Example - View Metrics","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/metrics?tenantId=tenantId&userId=userId&datasetName=APICreateDatasetExample1","host":["https://www.letsdata.io"],"path":["api","metrics"],"query":[{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner."},{"key":"datasetName","value":"APICreateDatasetExample1","description":"The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022"},{"key":"dashboardName","value":"TaskDetails","description":"[Optional] The metrics dashboard name to get the metrics data. Allowed Values [ DatasetSummary, TaskDetails]. Defaults to DatasetSummary","disabled":true},{"key":"iteration","value":"0","description":"[Optional] The dataset tasks are run initially when the dataset is created and initialized. This creates dataset execution metrics and logs - we call this iteration 0. In case there are task errors, the dataset tasks are redriven - this causes another iteration of the dataset execution that emits metrics and logs - we call this iteration 1. By default, the api lists metrics for all iterations of the dataset, paginated due to data size limits. In case the user is interested only in a specific dataset execution iteration, they can specify this via `&iteration=iteration_number` parameter.","disabled":true},{"key":"next","value":"","description":"[Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved.","disabled":true},{"key":"viewMetricsDatetimeList","value":"%5B%7B%22startDatetime%22%3A1669389422030%2C%22endDatetime%22%3A1669390555470%7D%2C%7B%22startDatetime%22%3A1669390855470%2C%22endDatetime%22%3A1669391155470%7D%5D","description":"[Optional] The dataset json has execution logs structure that has the start and end datetime for each iteration. User's can specify a start datetime and an end datetime from either these execution logs or a different start and end time interval. #Lets Data would query all the metrics in the query time intervals and return the results. For example, to get the metrics for dataset for specific datetimes, specify the datetimes as the following viewMetricDatetimesList json, then url encode this json and specify this as the `viewMetricsDatetimeList` parameter.\n```\n [\n {\n \"startDatetime\":1669389422030,\n \"endDatetime\":1669390555470\n },\n {\n \"startDatetime\":1669390855470,\n \"endDatetime\":1669391155470\n }\n ]\n\n # compacted and url encoded and specified as a parameter\n #&viewMetricsDatetimeList=%5B%7B%22startDatetime%22%3A1669389422030%2C%22endDatetime%22%3A1669390555470%7D%2C%7B%22startDatetime%22%3A1669390855470%2C%22endDatetime%22%3A1669391155470%7D%5D\n```","disabled":true}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 17:24:00 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"3701"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"3ae8724f-d2a0-40fd-ac7d-bc01a6715361"},{"key":"x-amz-apigw-id","value":"UbHqmE6xoAMEMbA="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65edeca9-3e2598ca52673e327b84bf7d"}],"cookie":[],"responseTime":null,"body":"{\n \"charts\": [\n {\n \"startDatetime\": 1710091080895,\n \"endDatetime\": 1710091499910,\n \"taskExecutionNumber\": 0,\n \"chartDataList\": {\n \"Task S3 Bytes Read (sum) & Write Connector Bytes Written (sum)\": {\n \"labels\": [\n 1710091140000,\n 1710091200000,\n 1710091260000,\n 1710091320000,\n 1710091380000\n ],\n \"datasets\": [\n {\n \"label\": \"S3 Bytes Read (KB)\",\n \"data\": [\n 32233.5576171875,\n 126486.943359375,\n 105959.5732421875,\n 102334.5478515625,\n 102620.064453125\n ],\n \"borderColor\": \"red\",\n \"backgroundColor\": \"red\",\n \"yAxisID\": \"y\"\n },\n {\n \"label\": \"Write Connector Bytes Written (KB)\",\n \"data\": [\n 11800.3564453125,\n 36803.1103515625,\n 37384.0302734375,\n 35824.4384765625,\n 36376.2275390625\n ],\n \"borderColor\": \"green\",\n \"backgroundColor\": \"green\",\n \"yAxisID\": \"y1\"\n }\n ]\n },\n \"Task Write Connector Put Retries (%)\": {\n \"labels\": [\n 1710091140000,\n 1710091200000,\n 1710091260000,\n 1710091320000,\n 1710091380000\n ],\n \"datasets\": [\n {\n \"label\": \"Write Connector Put Retries (%)\",\n \"data\": [\n 0,\n 0.21739130434782608,\n 0.3333333333333333,\n 0.07692307692307693,\n 0\n ],\n \"borderColor\": \"red\",\n \"backgroundColor\": \"red\",\n \"yAxisID\": \"y\"\n }\n ]\n },\n \"Task Individual Record Latencies (avg) and Number of Samples (count)\": {\n \"labels\": [\n 1710091140000,\n 1710091200000,\n 1710091260000,\n 1710091320000,\n 1710091380000\n ],\n \"datasets\": [\n {\n \"label\": \"Record Latency Avg (millisec)\",\n \"data\": [\n 16.576608187134504,\n 15.0920823798627,\n 14.267602339181286,\n 14.513117408906883,\n 14.55578947368421\n ],\n \"borderColor\": \"red\",\n \"backgroundColor\": \"red\",\n \"yAxisID\": \"y\"\n },\n {\n \"label\": \"Record Latency Min (millisec)\",\n \"data\": [\n 9,\n 9,\n 9,\n 8,\n 8\n ],\n \"borderColor\": \"green\",\n \"backgroundColor\": \"green\",\n \"yAxisID\": \"y\"\n },\n {\n \"label\": \"Record Latency Max (millisec)\",\n \"data\": [\n 289,\n 415,\n 226,\n 158,\n 120\n ],\n \"borderColor\": \"blue\",\n \"backgroundColor\": \"blue\",\n \"yAxisID\": \"y\"\n },\n {\n \"label\": \"Number of Samples (count)\",\n \"data\": [\n 4275,\n 10925,\n 12825,\n 12350,\n 11875\n ],\n \"borderColor\": \"brown\",\n \"backgroundColor\": \"brown\",\n \"yAxisID\": \"y1\"\n }\n ]\n },\n \"Task Success (%) & Number of Tasks (sum)\": {\n \"labels\": [],\n \"datasets\": [\n {\n \"label\": \"Task Success (%)\",\n \"data\": [],\n \"borderColor\": \"red\",\n \"backgroundColor\": \"red\",\n \"yAxisID\": \"y\"\n },\n {\n \"label\": \"Number of Tasks (count)\",\n \"data\": [],\n \"borderColor\": \"green\",\n \"backgroundColor\": \"green\",\n \"yAxisID\": \"y1\"\n }\n ]\n },\n \"Task Checkpoint Success (%) & Latency (avg)\": {\n \"labels\": [\n 1710091140000,\n 1710091200000,\n 1710091260000,\n 1710091320000,\n 1710091380000\n ],\n \"datasets\": [\n {\n \"label\": \"Task Checkpoint Success (%)\",\n \"data\": [\n 1,\n 1,\n 1,\n 1,\n 1\n ],\n \"borderColor\": \"red\",\n \"backgroundColor\": \"red\",\n \"yAxisID\": \"y\"\n },\n {\n \"label\": \"Task Checkpoint Latency (millisec)\",\n \"data\": [\n 9.88888888888889,\n 7.739130434782608,\n 7.037037037037037,\n 8.307692307692308,\n 7\n ],\n \"borderColor\": \"green\",\n \"backgroundColor\": \"green\",\n \"yAxisID\": \"y1\"\n }\n ]\n },\n \"Task Latency (avg)\": {\n \"labels\": [],\n \"datasets\": [\n {\n \"label\": \"Task Latency (millisec)\",\n \"data\": [],\n \"borderColor\": \"red\",\n \"backgroundColor\": \"red\",\n \"yAxisID\": \"y\"\n }\n ]\n },\n \"Task Write Connector Put Volume (sum) & Latency (avg)\": {\n \"labels\": [\n 1710091140000,\n 1710091200000,\n 1710091260000,\n 1710091320000,\n 1710091380000\n ],\n \"datasets\": [\n {\n \"label\": \"Write Connector Put Volume (count)\",\n \"data\": [\n 9,\n 28,\n 36,\n 28,\n 25\n ],\n \"borderColor\": \"red\",\n \"backgroundColor\": \"red\",\n \"yAxisID\": \"y\"\n },\n {\n \"label\": \"Write Connector Put Latency (millisec)\",\n \"data\": [\n 204.55555555555554,\n 125.46428571428571,\n 98.38888888888889,\n 130.57142857142858,\n 147.16\n ],\n \"borderColor\": \"green\",\n \"backgroundColor\": \"green\",\n \"yAxisID\": \"y1\"\n }\n ]\n },\n \"Task Records Processed (sum)\": {\n \"labels\": [\n 1710091140000,\n 1710091200000,\n 1710091260000,\n 1710091320000,\n 1710091380000\n ],\n \"datasets\": [\n {\n \"label\": \"Task Records Processed (count)\",\n \"data\": [\n 4275,\n 10925,\n 12825,\n 12350,\n 12350\n ],\n \"borderColor\": \"red\",\n \"backgroundColor\": \"red\",\n \"yAxisID\": \"y\"\n },\n {\n \"label\": \"Task Records Skipped (count)\",\n \"data\": [\n null,\n null,\n null,\n null,\n null\n ],\n \"borderColor\": \"green\",\n \"backgroundColor\": \"green\",\n \"yAxisID\": \"y\"\n },\n {\n \"label\": \"Task Records Errors (count)\",\n \"data\": [\n null,\n null,\n null,\n null,\n null\n ],\n \"borderColor\": \"blue\",\n \"backgroundColor\": \"blue\",\n \"yAxisID\": \"y\"\n }\n ]\n }\n }\n }\n ]\n}"}],"_postman_id":"13b3f57f-31c3-4bf4-ad74-82b8be2102a6"}],"id":"8b276cac-bd42-4379-bee2-aeea4e767df4","description":"

The metrics resource that has api for metrics for LetsData datasets.

\n","_postman_id":"8b276cac-bd42-4379-bee2-aeea4e767df4"},{"name":"vpc","item":[{"name":"acceptvpcpeeringconnection","item":[{"name":"Accept VPC Peering Connection","id":"a6e02325-2f8f-4c0e-ae82-904d27ca9c3b","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"body":{"mode":"raw","raw":"{\n \"tenantId\": \"tenantId\",\n \"userId\": \"userId\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"vpcPeeringConnectionId\": \"pcx-0f228c6802a234381\",\n \"requesterVpcId\": \"vpc-08411a062ce92ba17\",\n \"accepterVpcId\": \"vpc-0f8e45ffd448f959f\"\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/vpc/acceptvpcpeeringconnection","description":"

vpc/acceptvpcpeeringconnection POST

The vpc/acceptvpcpeeringconnection POST api can be used to accept an incoming create vpcPeeringConnection request for a dataset / vpc.

Input Parameters:

The POST body for a JSON request has the following schema:

{\n    \"tenantId\": \"the dataset's tenantId\",\n    \"userId\": \"the dataset's userId\",\n    \"datasetName\": \"the datasetName\",\n    \"vpcPeeringConnectionId\": \"the vpc peering connection id\",\n    \"requesterVpcId\": \"the id of the requester vpc\",\n    \"accepterVpcId\": \"the id of the accepter vpc\"\n}\n

Here are the details for the JSON request schema:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For Example, --userId 078260ed-3124-4de0-8eee-cc5b5025e7ad (TODO - this can be optional, API gets it from token)
datasetName: The dataset name for the dataset that the user wants to run the command for.
vpcPeeringConnectionId: The vpcPeeringConnectionId of the VpcPeeringConnection
requesterVpcId: The requesterVpcId for the AcceptVpcPeeringConnection request
accepterVpcId: The accepterVpcId for the AcceptVpcPeeringConnection request

Examples:

For example, a POST request to the vpc/acceptvpcpeeringconnection resource with the following body would accept an incoming vpcPeeringConnection for dataset named IndexWebCrawlDataDec2022 belonging to the tenant (tenantId: d5feaf90-71a9-41ee-b1b9-35e4242c3155) and user (userId: accb3567-2b6e-41ae-b00d-6ce1f9a58d94). The vpcPeeringConnectionId is pcx-0f228c6802a234381 and creates a vpc connection between requester vpc with id vpc-08411a062ce92ba17 and accepter vpc with id vpc-0f8e45ffd448f959f:

{\n    \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n    \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n    \"datasetName\": \"IndexWebCrawlDataDec2022\",\n    \"vpcPeeringConnectionId\": \"pcx-0f228c6802a234381\",\n    \"requesterVpcId\": \"vpc-08411a062ce92ba17\",\n    \"accepterVpcId\": \"vpc-0f8e45ffd448f959f\"\n}\n

Output Parameters:

The HttpStatusCode of the response can be looked at to determine success / error. The output is a JSON map that has the dataset's vpc listing as follows:

    {\n        \"datasetName\": \"String - the datasetName\",\n        \"vpcPeeringConnectionId\": \"String - the vpcConnectionId\",\n        \"requesterVpcId\": \"String - the requesterVpcId (customerVpcId)\",\n        \"accepterVpcId\": \"String - the accepterVpcId (letsdataVpcId)\",\n        \"statusCode\": \"DATASET_NOT_FOUND|INVALID_VPC_ID|DELETED|VPC_ROUTE_TABLE_NOT_FOUND|INVALID_VPC_PEERING_CONNECTION_STATE|VPC_PEERING_CONNECTION_NOT_READY|VPC_PEERING_CONNECTION_PROVISIONING|SUCCESS_ALREADY_ACTIVE|SUCCESS\",\n        \"errorMessage\": \"String - the error detail message\"\n    }\n

Actual Example Output:

Here is an actual example output for the command:

     {\n         \"datasetName\": \"IndexWebCrawlData\",\n         \"vpcPeeringConnectionId\": \"pcx-08535f2c54605f757\",\n         \"requesterVpcId\": \"vpc-07d99a687bc63c9a2\",\n         \"accepterVpcId\": \"vpc-0855e029d79665db8\",\n         \"statusCode\": \"SUCCESS\",\n         \"errorMessage\": \"Accepted the vpcPeeringConnectionId and created route table entry requesterVpc cidr to vpcPeeringConnection route\"\n     }\n

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

vpcPeeringConnection state is already ACTIVE

 {\n     \"datasetName\": \"String - the datasetName\",\n     \"vpcPeeringConnectionId\": \"String - the vpcConnectionId\",\n     \"requesterVpcId\": \"String - the requesterVpcId (customerVpcId)\",\n     \"accepterVpcId\": \"String - the accepterVpcId (letsdataVpcId)\",\n     \"statusCode\": \"SUCCESS_ALREADY_ACTIVE\",\n     \"errorMessage\": \"vpcPeeringConnection state is already ACTIVE\"\n }\n

202

Accepted the vpcPeeringConnectionId and created route table entry requesterVpc cidr to vpcPeeringConnection route

{\n    ...\n    \"statusCode\": \"SUCCESS\",\n    \"errorMessage\": \"Accepted the vpcPeeringConnectionId and created route table entry requesterVpc cidr to vpcPeeringConnection route\"\n}\n

vpcPeeringConnection state is %s. Wait till it completes to ACTIVE

{\n    ...\n    \"statusCode\": \"VPC_PEERING_CONNECTION_PROVISIONING\",\n    \"errorMessage\": \"vpcPeeringConnection state is %s. Wait till it completes to ACTIVE\"\n}\n

vpcId invalid for the dataset

{\n    ...\n    \"statusCode\": \"INVALID_VPC_ID\",\n    \"message\": \"vpcId invalid for the dataset - tenantId: %s, userId: %s, datasetName: %s, accepterVpcId: %s\"\n}\n

accepterVpcId in request is different from accepterVpcId in vpcPeeringConnection

{\n    ...\n    \"statusCode\": \"INVALID_VPC_ID\",\n    \"message\": \"accepterVpcId in request is different from accepterVpcId in vpcPeeringConnection\"\n}\n

requesterVpcId in request is different from requesterVpcId in vpcPeeringConnection

{\n    ...\n    \"statusCode\": \"INVALID_VPC_ID\",\n    \"message\": \"requesterVpcId in request is different from requesterVpcId in vpcPeeringConnection\"\n}\n

404:

The dataset for the tenantId, userId and datasetName was not found in the database.

  {\n        \"statusCode\", \"DATASET_NOT_FOUND\",\n        \"message\", \"Dataset not found in the database.\"\n  }\n

datasetStatus is DELETED.

  {\n        \"statusCode\", \"DELETED\",\n        \"message\", \"datasetStatus is DELETED.\"\n  }\n

VpcPeeringConnection for vpcPeeringConnectionId: %s not found.

  {\n        \"statusCode\", \"NOT_FOUND\",\n        \"message\", \"VpcPeeringConnection for vpcPeeringConnectionId: %s not found.\"\n  }\n

409:

vpcPeeringConnection state is invalid

  {\n        \"statusCode\", \"INVALID_VPC_PEERING_CONNECTION_STATE\",\n        \"message\", \"vpcPeeringConnection state is invalid - state: %s\"\n  }\n

412:

vpcPeeringConnection state is %s. Retry when the vpcPeeringConnection is ready for acceptance (state: PENDING-ACCEPTANCE)

  {\n        \"statusCode\", \"VPC_PEERING_CONNECTION_NOT_READY\",\n        \"message\", \"vpcPeeringConnection state is %s. Retry when the vpcPeeringConnection is ready for acceptance (state: PENDING-ACCEPTANCE)\"\n  }\n

500:

accepterVpc route table not found

      {\n          \"statusCode\": \"VPC_ROUTE_TABLE_NOT_FOUND\",\n          \"message\": \"accepterVpc route table not found\"\n      }\n\n

An unexpected error has occurred.

      {\n          \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n          \"message\": \"Internal Server Error, please try again later.\"\n      }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).

Docs

You can learn about Vpc in #LetsData at: https://www.letsdata.io/docs#vpcs
VpcPeeringConnections in AWS docs: https://docs.aws.amazon.com/vpc/latest/peering/vpc-peering-basics.html

\n","urlObject":{"path":["api","vpc","acceptvpcpeeringconnection"],"host":["https://www.letsdata.io"],"query":[],"variable":[]}},"response":[{"id":"b36f4df0-d4ed-4a40-ab5d-b14fe1db0dc9","name":"Example - Accept VPC Peering Connection","originalRequest":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"body":{"mode":"raw","raw":"{\n \"tenantId\": \"tenantId\",\n \"userId\": \"userId\",\n \"datasetName\": \"APICreateDatasetExample2\",\n \"vpcPeeringConnectionId\": \"pcx-0cce9ffda24dc99a6\",\n \"requesterVpcId\": \"vpc-07d99a687bc63c9a2\",\n \"accepterVpcId\": \"vpc-0e6ebec64cb11ac34\"\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/vpc/acceptvpcpeeringconnection"},"status":"Accepted","code":202,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 21:04:39 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"321"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"519cfc75-7540-4321-ba88-37956c0f3a25"},{"key":"x-amz-apigw-id","value":"Ubn-0HZaIAMECkQ="},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee205e-1034e78b16781fb821a487d3"}],"cookie":[],"responseTime":null,"body":"{\n \"datasetName\": \"APICreateDatasetExample2\",\n \"accepterVpcId\": \"vpc-0e6ebec64cb11ac34\",\n \"requesterVpcId\": \"vpc-07d99a687bc63c9a2\",\n \"vpcPeeringConnectionId\": \"pcx-0cce9ffda24dc99a6\",\n \"statusCode\": \"SUCCESS\",\n \"message\": \"Accepted the vpcPeeringConnectionId and created route table entry requesterVpc cidr to vpcPeeringConnection route\"\n}"}],"_postman_id":"a6e02325-2f8f-4c0e-ae82-904d27ca9c3b"}],"id":"3de3963e-392f-4b4b-81d0-9110ccda6c91","description":"

The acceptvpcpeeringconnection sub resource of the VPCs has the api that can be used to accept an incoming vpc peering connection request.

\n","_postman_id":"3de3963e-392f-4b4b-81d0-9110ccda6c91"},{"name":"deletevpcpeeringconnection","item":[{"name":"Delete VPC Peering Connection","id":"238bc513-0e23-465f-88cb-25ff7bb69357","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"body":{"mode":"raw","raw":"{\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"IndexWebCrawlDataDec2022\",\n \"vpcPeeringConnectionId\": \"pcx-0f228c6802a234381\",\n \"letsdataVpcId\": \"vpc-08411a062ce92ba17\",\n \"customerVpcId\": \"vpc-0f8e45ffd448f959f\"\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/vpc/deletevpcpeeringconnection","description":"

vpc/deletevpcpeeringconnection POST

The vpc/deletevpcpeeringconnection POST api deletes a vpcPeeringConnection.

Input Parameters:

The POST body for a JSON request has the following schema:

{\n    \"tenantId\": \"the dataset's tenantId\",\n    \"userId\": \"the dataset's userId\",\n    \"datasetName\": \"the datasetName\",\n    \"vpcPeeringConnectionId\": \"the vpc peering connection id\",\n    \"letsdataVpcId\": \"the id of the letsdata vpc\",\n    \"customerVpcId\": \"the id of the customer vpc\"\n}\n

Here are the details for the JSON request schema:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For Example, --userId 078260ed-3124-4de0-8eee-cc5b5025e7ad (TODO - this can be optional, API gets it from token)
datasetName: The dataset name for the dataset that the user wants to run the command for.
vpcPeeringConnectionId: The vpcPeeringConnectionId of the VpcPeeringConnection
letsdataVpcId: The letsdataVpcid for the DeleteVpcPeeringConnection request
customerVpcId: The customerVpcId for the DeleteVpcPeeringConnection request

Examples:

For example, a POST request to the vpc/deletevpcpeeringconnection resource with the following body would delete a vpcPeeringConnection for dataset named IndexWebCrawlDataDec2022 belonging to the tenant (tenantId: d5feaf90-71a9-41ee-b1b9-35e4242c3155) and user (userId: accb3567-2b6e-41ae-b00d-6ce1f9a58d94). The vpcPeeringConnectionId is pcx-0f228c6802a234381 and deletes a vpc connection between letsdata vpc with id vpc-08411a062ce92ba17 and customer vpc with id vpc-0f8e45ffd448f959f:

{\n    \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n    \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n    \"datasetName\": \"IndexWebCrawlDataDec2022\",\n    \"vpcPeeringConnectionId\": \"pcx-0f228c6802a234381\",\n    \"letsdataVpcId\": \"vpc-08411a062ce92ba17\",\n    \"customerVpcId\": \"vpc-0f8e45ffd448f959f\"\n}\n

Output Parameters:

The HttpStatusCode of the response can be looked at to determine success / error. The output is a JSON map that has the dataset's vpc listing as follows:

    {\n      \"datasetName\": \"String - the datasetName\",\n      \"customerVpcId\": \"String - the customerVpcId\",\n      \"letsdataVpcId\": \"String - the letsdataVpcId\",\n      \"vpcPeeringConnectionId\": \"String - the vpcConnectionId\",\n      \"statusCode\": \"NOT_FOUND|INVALID_VPC_ID|DATASET_STATUS_DELETED|NOT_ALLOWED_AT_THIS_TIME|SUCCESS_TERMINAL_STATUS_CODE|SUCCESS\",\n      \"errorMessage\": \"String - the error detail message\"\n    }\n

Actual Example Output:

Here is an actual example output for the command:

     {\n         \"datasetName\": \"IndexWebCrawlData\",\n         \"customerVpcId\": \"vpc-07d99a687bc63c9a2\",\n         \"letsdataVpcId\": \"vpc-0855e029d79665db8\",\n         \"vpcPeeringConnectionId\": \"pcx-08535f2c54605f757\",\n         \"statusCode\": \"SUCCESS\",\n         \"errorMessage\": \"vpcPeeringConnection successfully deleted\"\n     }\n

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

vpcPeeringConnection successfully deleted

 {\n     ...\n     \"statusCode\": \"SUCCESS\",\n     \"errorMessage\": \"vpcPeeringConnection successfully deleted\"\n }\n

202

Accepted the vpcPeeringConnectionId and created route table entry requesterVpc cidr to vpcPeeringConnection route

{\n    ...\n    \"statusCode\": \"SUCCESS_TERMINAL_STATUS_CODE\",\n    \"errorMessage\": \"vpcPeeringConnection is already in a terminal state - statusCode: %s\"\n}\n

vpcId invalid for the dataset

{\n    ...\n    \"statusCode\": \"INVALID_VPC_ID\",\n    \"message\": \"vpcId invalid for the dataset - tenantId: %s, userId: %s, datasetName: %s, letsdataVpcId: %s\"\n}\n

customerVpcId in request is different from requesterVpcId in vpcPeeringConnection

{\n    ...\n    \"statusCode\": \"INVALID_VPC_ID\",\n    \"message\": \"customerVpcId in request is different from requesterVpcId in vpcPeeringConnection\"\n}\n

letsdataVpcId in request is different from accepterVpcId in vpcPeeringConnection

{\n    ...\n    \"statusCode\": \"INVALID_VPC_ID\",\n    \"message\": \"letsdataVpcId in request is different from accepterVpcId in vpcPeeringConnection\"\n}\n

404:

The dataset for the tenantId, userId and datasetName was not found in the database.

  {\n        \"statusCode\", \"DATASET_NOT_FOUND\",\n        \"message\", \"Dataset not found in the database.\"\n  }\n

datasetStatus is DELETED.

  {\n        \"statusCode\", \"DELETED\",\n        \"message\", \"datasetStatus is DELETED.\"\n  }\n

VpcPeeringConnection for vpcPeeringConnectionId: %s not found.

  {\n        \"statusCode\", \"NOT_FOUND\",\n        \"message\", \"VpcPeeringConnection for vpcPeeringConnectionId: %s not found.\"\n  }\n

412:

vpcPeeringConnection is already in a transient state in which deletion is not allowed. Please try again later. vpcPeeringConnectionStatusCode: %s

  {\n        \"statusCode\", \"NOT_ALLOWED_AT_THIS_TIME\",\n        \"message\", \"vpcPeeringConnection is already in a transient state in which deletion is not allowed. Please try again later. vpcPeeringConnectionStatusCode: %s\"\n  }\n

500:

An unexpected error has occurred.

      {\n          \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n          \"message\": \"Internal Server Error, please try again later.\"\n      }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).

Docs

You can learn about Vpc in #LetsData at: https://www.letsdata.io/docs#vpcs
VpcPeeringConnections in AWS docs: https://docs.aws.amazon.com/vpc/latest/peering/vpc-peering-basics.html

\n","urlObject":{"path":["api","vpc","deletevpcpeeringconnection"],"host":["https://www.letsdata.io"],"query":[],"variable":[]}},"response":[{"id":"35d3714a-bb7b-4a3f-bba2-d2782322158c","name":"Example - Delete VPC Peering Connection","originalRequest":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"body":{"mode":"raw","raw":"{\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"APICreateDatasetExample2\",\n \"vpcPeeringConnectionId\": \"pcx-0cce9ffda24dc99a6\",\n \"letsdataVpcId\": \"vpc-0e6ebec64cb11ac34\",\n \"customerVpcId\": \"vpc-07d99a687bc63c9a2\"\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/vpc/deletevpcpeeringconnection"},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 21:06:49 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"248"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"43ed3865-78b2-4671-8a02-a50aa7fdb21f"},{"key":"x-amz-apigw-id","value":"UboTUHOiIAMEDSA="},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee20e1-2d94bc3d4e275202149a24b2"}],"cookie":[],"responseTime":null,"body":"{\n \"datasetName\": \"APICreateDatasetExample2\",\n \"customerVpcId\": \"vpc-07d99a687bc63c9a2\",\n \"letsdataVpcId\": \"vpc-0e6ebec64cb11ac34\",\n \"vpcPeeringConnectionId\": \"pcx-0cce9ffda24dc99a6\",\n \"statusCode\": \"SUCCESS\",\n \"message\": \"vpcPeeringConnection successfully deleted\"\n}"}],"_postman_id":"238bc513-0e23-465f-88cb-25ff7bb69357"}],"id":"f1878adb-fb64-41ad-b29c-24316d95c933","description":"

The deletevpcpeeringconnection sub resource of the VPCs has the api that can be used to delete a dataset's vpc peering connection.

\n","_postman_id":"f1878adb-fb64-41ad-b29c-24316d95c933"},{"name":"list","item":[{"name":"List VPCs","id":"fe185bb8-8edc-4bb0-9e8a-7daf93642a0c","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/vpc/list?tenantId=tenantId&userId=userId&datasetName=CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20","description":"

vpc/list - GET

Use the vpc/list GET api to list the details of the vpcs associated with the dataset. In the most complex scenario, a dataset's readConnector, writeConnector, errorConnector and computeEngine might be in a different Vpcs and these are connected with VpcPeeringConnections for dataset processing. This command can be used to list the details of all the vpcs for the dataset.

Input Parameters:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For example, &userId=078260ed-3124-4de0-8eee-cc5b5025e7ad
datasetName: The dataset name for the dataset that the user wants to run the command for. For example, &datasetName=IndexWebCrawlDataDec2022

Output Parameters:

The output is a JSON map that has the following sections:

  {\n    \"datasetName\": \"String\",\n    \"vpc\": {    # map of connectorType and its vpc details\n      \"readConnector|writeConnector|errorConnector|computeEngine\": {\n        \"vpcId\": \"String - the vpcId\",\n        \"vpcName\": \"String - the vpcName\",\n        \"ownerId\": \"String - the vpc's owner aws account id\",\n        \"state\": \"pending|available\",\n        \"cidrBlock\": \"String - the ip address range in cidr notation X.X.X.X/X\",\n        \"subnets\": { # map of subnet type and the subnets\n          \"private|public\": {    # map of availability zone and the subnet details\n            \"us-east-1a|us-east-1b|us-east-1c\": {\n              \"subnetId\": \"String - the subnetId\",\n              \"subnetName\": \"String - the subnetName\",\n              \"state\": \"pending|available\",\n              \"subnetCidr\": \"String - the subnet IP range in cidr notation X.X.X.X/X\",\n              \"availabilityZone\": \"us-east-1a|us-east-1b|us-east-1c\",\n              \"availableIpAddressCount\": Integer - number of IP addresses available\n            }\n        },\n        \"securityGroups\": [\n          \"String - securityGroupId\"\n        ]\n      }\n    }\n  }\n\n

Actual Example Output:

Here is an actual example output for the command:

   {\n     \"datasetName\": \"IndexWebCrawlDataDec2022\",\n     \"vpc\": {\n       \"writeConnector\": {\n         \"vpcId\": \"vpc-0855e029d79665db8\",\n         \"vpcName\": \"Test-d2596dbbbfef27b362b82351d1673d50-vpc\",\n         \"ownerId\": \"223413462631\",\n         \"state\": \"available\",\n         \"cidrBlock\": \"10.0.16.0/25\",\n         \"subnets\": {\n           \"private\": {\n             \"us-east-1a\": {\n               \"subnetId\": \"subnet-0c870b86356567630\",\n               \"subnetName\": \"Test-subnet-dataset-d2596dbbbfef27b362b82351d1673d50-private-az2\",\n               \"state\": \"available\",\n               \"subnetCidr\": \"10.0.16.0/28\",\n               \"availabilityZone\": \"us-east-1a\",\n               \"availableIpAddressCount\": 7\n             },\n             \"us-east-1b\": {\n               \"subnetId\": \"subnet-04f1507cf193c28a7\",\n               \"subnetName\": \"Test-subnet-dataset-d2596dbbbfef27b362b82351d1673d50-private-az3\",\n               \"state\": \"available\",\n               \"subnetCidr\": \"10.0.16.16/28\",\n               \"availabilityZone\": \"us-east-1b\",\n               \"availableIpAddressCount\": 7\n             },\n             \"us-east-1c\": {\n               \"subnetId\": \"subnet-04ceae4af5bf9ef99\",\n               \"subnetName\": \"Test-subnet-dataset-d2596dbbbfef27b362b82351d1673d50-private-az1\",\n               \"state\": \"available\",\n               \"subnetCidr\": \"10.0.16.32/28\",\n               \"availabilityZone\": \"us-east-1c\",\n               \"availableIpAddressCount\": 7\n             }\n           },\n           \"public\": {\n             \"us-east-1a\": {\n               \"subnetId\": \"subnet-0047e884ac558d3ff\",\n               \"subnetName\": \"Test-subnet-dataset-d2596dbbbfef27b362b82351d1673d50-public-az1\",\n               \"state\": \"available\",\n               \"subnetCidr\": \"10.0.16.48/28\",\n               \"availabilityZone\": \"us-east-1a\",\n               \"availableIpAddressCount\": 10\n             },\n             \"us-east-1c\": {\n               \"subnetId\": \"subnet-02e4f4a3f28ca033a\",\n               \"subnetName\": \"Test-subnet-dataset-d2596dbbbfef27b362b82351d1673d50-public-az3\",\n               \"state\": \"available\",\n               \"subnetCidr\": \"10.0.16.80/28\",\n               \"availabilityZone\": \"us-east-1c\",\n               \"availableIpAddressCount\": 10\n             },\n             \"us-east-1b\": {\n               \"subnetId\": \"subnet-02b13bf0d75bb94cb\",\n               \"subnetName\": \"Test-subnet-dataset-d2596dbbbfef27b362b82351d1673d50-public-az2\",\n               \"state\": \"available\",\n               \"subnetCidr\": \"10.0.16.64/28\",\n               \"availabilityZone\": \"us-east-1b\",\n               \"availableIpAddressCount\": 10\n             }\n           }\n         },\n         \"securityGroups\": [\n           \"sg-0720564658f407980\"\n         ]\n       }\n     }\n   }\n\n

Here are the different HttpStatusCodes that are returned and their sub cases:

200:
\n
- Request successfully retrieved the tasks for the dataset. The response body has the tasks, taskLogs and a next token for pagination.
  \n
```
    {\n        \"datasetName\": \"...\",\n        \"vpc\": {\n          ...\n        }\n      }\n\n
```
  \n
\n
404:
\n
- The dataset for the tenantId, userId and datasetName was not found in the database. An error code and error message is returned in the response JSON.
  \n
```
    {\n      \"statusCode\": \"NOT_FOUND\",\n      \"message\": \"Dataset not found for tenantId: %s, userId: %s, datasetName: %s\"\n    }\n\n
```
  \n
- The dataset has been deleted. Any task databases should have been deleted as well.
  \n
```
    {\n      \"statusCode\": \"DELETED\",\n      \"message\": \"datasetStatus is DELETED.\"\n    }\n\n
```
  \n
\n

500:

An unexpected error has occurred.

            {\n            \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n            \"message\": \"Internal Server Error, please try again later.\"\n            }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
\n

Details

Connector Destinations such as AWS Kafka require setting up a Virtual Private Cloud (vpc). Let's Data automatically creates and deletes the Vpc during the write connector initialization / deletion and provides self-service infrastructure to enable connectivity to these Vpcs.

VPC IP Addressing

The VPC IP address management is done automatically by #LetsData, here are some details on how LetsData manages the IP addresses for the datasets.

Each Vpc is assigned an IP address range (cidrBlock) from the Amazon's recommended private IP space. (We currently assign IPs in the 10.0.0.0 Ip address range).
We allocate a defined IP Range for a tenant (10.X.X.X/21 cidr ~ 2000 IPs) (TenantIPRange). Each dataset allocates a dataset IP range (DatasetIPRange) from the tenant's TenantIPRange and creates dataset resources using this dataset IP range.
One important point to note is that if the customer wants to establish a VpcPeeringConnection to this dataset's Vpc, the customer Vpc's cidrBlock should not overlap with the Dataset's cidrBlock. Choosing a specific IPRange is not allowed at this time, we may allow users to select a non overlapping IP Address Range in future.

In terms of how many IPs to allocate to each dataset, we allow users to specify different Vpc sizes in dataset configuration. We currently support the following vpc sizes:

small: This allocates a IP range with subnet mask set to 25 - this allocates around 128 IPs.
\n
medium: This allocates a IP range with subnet mask set to 23 - this allocates around 512 IPs.
\n
large: This allocates a IP range with subnet mask set to 22 - this allocates around 1024 IPs.
\n
Vpc Network Architecture
\n
Our standard vpc setup, as of now, in us-east-1 is as follows:
\n
Three private subnets, each in a different availability zone. The cluster resources are created in these private subnets.
\n
Three public subnets, one in each availability zone. These are connected to 3 nat gateways (one for each availability zone) for connectivity to AWS resources.
\n
Elastic network interfaces are created for the Data Task Lambda function to connect to the resources in the VPC.
\n
The security groups and network ACLs are currently configured to allow inbound / outbound TPC traffic on all ports.
\n
No Routes are currently configured to route external traffic to the resources in the private / public subnets. When a VpcPeeringConnection is established, we allow inbound traffic from the peer Vpc for TCP on all ports. (In case you are testing connectivity, ICMP (ping) / UDP etc might not work. Test with TCP.)
\n

Customer can access the vpc by setting a VpcPeeringConnection to this Vpc

  +------------------------------------------------------------------------------------------------------------------+\n  |                                                                                                                  |\n  |    +---------------------+         +---------------------+    +-----------------+                                |\n  |    | private subnet az1  |         |  public subnet az1  |----| NAT Gateway az1 |          +--------------+      |\n  |    +---------------------+         +---------------------+    +-----------------+          | Route Tables |      |\n  |                                                                                            +--------------+      |\n  |    +---------------------+         +---------------------+    +-----------------+                                |\n  |    | private subnet az2  |         |  public subnet az2  |----| NAT Gateway az2 |                                |\n  |    +---------------------+         +---------------------+    +-----------------+          +------------------+  |\n  |                                                                                            | Internet Gateway |  |\n  |    +---------------------+         +---------------------+    +-----------------+          +------------------+  |\n  |    | private subnet az3  |         |  public subnet az3  |----| NAT Gateway az3 |                                |\n  |    +---------------------+         +---------------------+    +-----------------+          +----------------+    |\n  |                                                                                            | Security Group |    |\n  |                                                                                            +----------------+    |\n  +------------------------------------------------------------------------------------------------------------------+\n                        |                                                        |\n                        |                                                        |\n  +---------------------------------------------+                    +--------------------------+\n  | Data Task Lambda Function network interface |                    | Vpc Peering Connections  |\n  +---------------------------------------------+                    +--------------------------+\n\n

Examples

Example 1: View the vpcs list for the datasetName 'IndexWebCrawlDataDec2022' - GET www.letsdata.io/api/vpc/list?tenantId=tenantId&userId=userId&datasetName=IndexWebCrawlDataDec2022
\n
Example 2: View the vpcs list for the datasetName 'IndexWebCrawlDataDec2022' that was created by another user (userId: 078260ed-3124-4de0-8eee-cc5b5025e7ad) in the organization - GET www.letsdata.io/api/vpc/list?tenantId=tenantId&userId=078260ed-3124-4de0-8eee-cc5b5025e7ad&datasetName=IndexWebCrawlDataDec2022
\n

Docs:

You can learn about Vpcs in #LetsData at: https://www.letsdata.io/docs#vpcs

\n","urlObject":{"path":["api","vpc","list"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

\n","type":"text/plain"},"key":"userId","value":"userId"},{"description":{"content":"

The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022

\n","type":"text/plain"},"key":"datasetName","value":"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20"}],"variable":[]}},"response":[{"id":"fe2a58b7-c471-4f35-9ba5-eb8b3caabe3f","name":"Example - List VPCs","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/vpc/list?tenantId=tenantId&userId=userId&datasetName=APICreateDatasetExample2","host":["https://www.letsdata.io"],"path":["api","vpc","list"],"query":[{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner."},{"key":"datasetName","value":"APICreateDatasetExample2","description":"The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022"}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 21:00:31 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"1755"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"bd9a017f-ddca-4546-9f1e-4185c33e9f7b"},{"key":"x-amz-apigw-id","value":"UbnYOGeUoAMEEXw="},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee1f67-631b79be6076894b11ac29c8"}],"cookie":[],"responseTime":null,"body":"{\n \"datasetName\": \"APICreateDatasetExample2\",\n \"vpc\": {\n \"writeConnector\": {\n \"vpcId\": \"vpc-0e6ebec64cb11ac34\",\n \"vpcName\": \"Test-ae787840c190dc0a97af8d2102682897-vpc\",\n \"ownerId\": \"223413462631\",\n \"state\": \"available\",\n \"cidrBlock\": \"10.0.16.0/25\",\n \"subnets\": {\n \"private\": {\n \"us-east-1a\": {\n \"subnetId\": \"subnet-0c4ca5e122d3581f8\",\n \"subnetName\": \"Test-subnet-dataset-ae787840c190dc0a97af8d2102682897-private-az3\",\n \"state\": \"available\",\n \"subnetCidr\": \"10.0.16.0/28\",\n \"availabilityZone\": \"us-east-1a\",\n \"availableIpAddressCount\": 9\n },\n \"us-east-1b\": {\n \"subnetId\": \"subnet-0322495504292f167\",\n \"subnetName\": \"Test-subnet-dataset-ae787840c190dc0a97af8d2102682897-private-az2\",\n \"state\": \"available\",\n \"subnetCidr\": \"10.0.16.16/28\",\n \"availabilityZone\": \"us-east-1b\",\n \"availableIpAddressCount\": 9\n },\n \"us-east-1c\": {\n \"subnetId\": \"subnet-01e27f9f8b42fcf93\",\n \"subnetName\": \"Test-subnet-dataset-ae787840c190dc0a97af8d2102682897-private-az1\",\n \"state\": \"available\",\n \"subnetCidr\": \"10.0.16.32/28\",\n \"availabilityZone\": \"us-east-1c\",\n \"availableIpAddressCount\": 9\n }\n },\n \"public\": {\n \"us-east-1b\": {\n \"subnetId\": \"subnet-0cb44671a303bc858\",\n \"subnetName\": \"Test-subnet-dataset-ae787840c190dc0a97af8d2102682897-public-az2\",\n \"state\": \"available\",\n \"subnetCidr\": \"10.0.16.64/28\",\n \"availabilityZone\": \"us-east-1b\",\n \"availableIpAddressCount\": 10\n },\n \"us-east-1c\": {\n \"subnetId\": \"subnet-0207d0fa59538b65d\",\n \"subnetName\": \"Test-subnet-dataset-ae787840c190dc0a97af8d2102682897-public-az1\",\n \"state\": \"available\",\n \"subnetCidr\": \"10.0.16.80/28\",\n \"availabilityZone\": \"us-east-1c\",\n \"availableIpAddressCount\": 10\n },\n \"us-east-1a\": {\n \"subnetId\": \"subnet-013e0e87ddca34e81\",\n \"subnetName\": \"Test-subnet-dataset-ae787840c190dc0a97af8d2102682897-public-az3\",\n \"state\": \"available\",\n \"subnetCidr\": \"10.0.16.48/28\",\n \"availabilityZone\": \"us-east-1a\",\n \"availableIpAddressCount\": 10\n }\n }\n },\n \"securityGroups\": [\n \"sg-0c27b3c17e87190fb\"\n ]\n }\n }\n}"}],"_postman_id":"fe185bb8-8edc-4bb0-9e8a-7daf93642a0c"}],"id":"84e06898-5153-418d-b809-56980c0e5395","description":"

The list sub resource for VPCs that has api for listing the VPCs of a dataset.

\n","_postman_id":"84e06898-5153-418d-b809-56980c0e5395"},{"name":"listvpcpeeringconnection","item":[{"name":"List VPC Peering Connections","id":"ff8d8404-5368-4630-9274-5f32da36f1b0","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/vpc/listvpcpeeringconnection?tenantId=tenantId&userId=userId&datasetName=CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20&vpcId=vpc-0855e029d79665db8","description":"

vpc/listvpcpeeringconnection - GET

Lists the details of the vpcPeeringConnections for a dataset / vpc.

Input Parameters:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For example, &userId=078260ed-3124-4de0-8eee-cc5b5025e7ad
datasetName: The dataset name for the dataset that the user wants to run the command for. For example, &datasetName=IndexWebCrawlDataDec2022
vpcId: The vpcId of the dataset's vpc. For example, &vpcId=vpc-0855e029d79665db8

Output Parameters:

The output is a JSON map that has the following sections:

  {\n    \"datasetName\": \"String - the datasetName\",\n    \"vpcId\": \"String - the dataset's vpcId\",\n    \"vpcPeeringConnections\": [\n      {\n        \"vpcPeeringConnectionId\": \"String - the vpcPeeringConnectionId\",\n        \"status\": {\n          \"code\": \"initiating-request|pending-acceptance|active|deleted|rejected|failed|expired|provisioning|deleting\",\n          \"message\": \"String - the status message\"\n        },\n        \"expirationTime\": Long - the datetime for the connection expiration,\n        \"accepterVpc\": {\n          \"vpcId\": \"String - the letsdataVpcId (accepter)\",\n          \"ownerId\": \"String - the letsdata aws account id\",\n          \"region\": \"String - the aws region for the letsdataVpc\"\n        },\n        \"requesterVpcInfo\": {\n          \"vpcId\": \"String - the customerVpcId (requester)\",\n          \"ownerId\": \"String - the customer aws account id\",\n          \"region\": \"String - the aws region for the customerVpc\",\n          \"cidrBlock\": \"String - the customer vpc ip range in cidr notation\"\n        }\n      }\n    ],\n    \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n    \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\"\n  }\n\n

Actual Example Output:

Here is an actual example output for the command:

   {\n     \"datasetName\": \"IndexWebCrawlDataDec2022\",\n     \"vpcId\": \"vpc-0855e029d79665db8\",\n     \"vpcPeeringConnections\": [\n       {\n         \"vpcPeeringConnectionId\": \"pcx-08535f2c54605f757\",\n         \"status\": {\n           \"code\": \"pending-acceptance\",\n           \"message\": \"Pending Acceptance by 223413462631\"\n         },\n         \"expirationTime\": 1690758032000,\n         \"accepterVpc\": {\n           \"vpcId\": \"vpc-0855e029d79665db8\",\n           \"ownerId\": \"223413462631\",\n           \"region\": \"us-east-1\"\n         },\n         \"requesterVpcInfo\": {\n           \"vpcId\": \"vpc-07d99a687bc63c9a2\",\n           \"ownerId\": \"151166716410\",\n           \"region\": \"us-east-1\",\n           \"cidrBlock\": \"10.0.0.0/24\"\n         }\n       }\n     ],\n     \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n     \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\"\n   }\n\n

Here are the different HttpStatusCodes that are returned and their sub cases:

200:
\n
- Request successfully retrieved the vpc peering connections for the dataset vpc. The response body has the vpcPeeringConnections list.
  \n
```
    {\n        \"datasetName\": \"...\",\n        \"vpcPeeringConnections\": [\n          ...\n        ]\n        ...\n    }\n\n
```
  \n
\n
404:
\n
- The dataset for the tenantId, userId and datasetName was not found in the database. An error code and error message is returned in the response JSON.
  \n
```
    {\n      \"statusCode\": \"DATASET_NOT_FOUND\",\n      \"message\": \"Dataset not found in the database.\"\n    }\n\n
```
  \n
- The dataset has been deleted. Any task databases should have been deleted as well.
  \n
```
    {\n      \"statusCode\": \"DELETED\",\n      \"message\": \"datasetStatus is DELETED.\"\n    }\n\n
```
  \n
\n

400

vpcId should equal dataset write connector vpcId

    {\n      \"statusCode\": \"INVALID_VPC_ID\",\n      \"message\": \"vpcId should equal dataset write connector vpcId\"\n    }\n\n

500:
\n
- An unexpected error has occurred.
  \n
```
    {\n        \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n        \"message\": \"Internal Server Error, please try again later.\"\n    }\n\n
```
  \n
- In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
  \n
\n

Examples

Example 1: View the vpcPeeringConnection list for the datasetName 'IndexWebCrawlDataDec2022' with vpcId 'vpc-0855e029d79665db8' - GET www.letsdata.io/api/vpc/listvpcpeeringconnection?tenantId=tenantId&userId=userId&datasetName=IndexWebCrawlDataDec2022&vpcId=vpc-0855e029d79665db8
Example 2: View the vpcPeeringConnection list for the datasetName 'IndexWebCrawlDataDec2022' that was created by another user (userId: 078260ed-3124-4de0-8eee-cc5b5025e7ad) in the organization with vpcId 'vpc-0855e029d79665db8' - GET www.letsdata.io/api/vpc/listvpcpeeringconnection?tenantId=tenantId&userId=078260ed-3124-4de0-8eee-cc5b5025e7ad&datasetName=IndexWebCrawlDataDec2022&vpcId=vpc-0855e029d79665db8

Docs:

You can learn about Vpcs in #LetsData at: https://www.letsdata.io/docs#vpcs
VpcPeeringConnections in AWS docs: https://docs.aws.amazon.com/vpc/latest/peering/vpc-peering-basics.html

\n","urlObject":{"path":["api","vpc","listvpcpeeringconnection"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

\n","type":"text/plain"},"key":"userId","value":"userId"},{"description":{"content":"

The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022

\n","type":"text/plain"},"key":"datasetName","value":"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20"},{"description":{"content":"

The vpcId of the dataset's vpc. For example, &vpcId=vpc-0855e029d79665db8

\n","type":"text/plain"},"key":"vpcId","value":"vpc-0855e029d79665db8"}],"variable":[]}},"response":[{"id":"6c92f02f-00b7-44bf-aa50-51b00c37392b","name":"Example - List VPC Peering Connections","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/vpc/listvpcpeeringconnection?tenantId=tenantId&userId=userId&datasetName=APICreateDatasetExample2&vpcId=vpc-0e6ebec64cb11ac34","host":["https://www.letsdata.io"],"path":["api","vpc","listvpcpeeringconnection"],"query":[{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner."},{"key":"datasetName","value":"APICreateDatasetExample2","description":"The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022"},{"key":"vpcId","value":"vpc-0e6ebec64cb11ac34","description":"The vpcId of the dataset's vpc. For example, `&vpcId=vpc-0855e029d79665db8`"}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 21:06:19 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"724"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"24220452-23b4-4be2-8afb-e87b9a3ea6d6"},{"key":"x-amz-apigw-id","value":"UboOoE_loAMEi6g="},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee20c3-1c0f5ef56b629ff54b4e69a4"}],"cookie":[],"responseTime":null,"body":"{\n \"datasetName\": \"APICreateDatasetExample2\",\n \"vpcId\": \"vpc-0e6ebec64cb11ac34\",\n \"vpcPeeringConnections\": [\n {\n \"vpcPeeringConnectionId\": \"pcx-0cce9ffda24dc99a6\",\n \"status\": {\n \"code\": \"active\",\n \"message\": \"Active\"\n },\n \"expirationTime\": null,\n \"accepterVpc\": {\n \"vpcId\": \"vpc-0e6ebec64cb11ac34\",\n \"ownerId\": \"223413462631\",\n \"region\": \"us-east-1\",\n \"cidrBlock\": \"10.0.16.0/25\",\n \"peeringOptions\": {\n \"allowDnsResolutionFromRemoteVpc\": false,\n \"allowEgressFromLocalVpcToRemoteClassicLink\": false,\n \"allowEgressFromLocalClassicLinkToRemoteVpc\": false\n }\n },\n \"requesterVpcInfo\": {\n \"vpcId\": \"vpc-07d99a687bc63c9a2\",\n \"ownerId\": \"151166716410\",\n \"region\": \"us-east-1\",\n \"cidrBlock\": \"10.0.0.0/24\"\n }\n }\n ],\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\"\n}"}],"_postman_id":"ff8d8404-5368-4630-9274-5f32da36f1b0"}],"id":"44aef47a-70d3-4bcf-a102-2cc92b71023f","description":"

The listvpcpeeringconnection sub resource of the VPCs has the api that can be used to list a dataset's vpc peering connections.

\n","_postman_id":"44aef47a-70d3-4bcf-a102-2cc92b71023f"}],"id":"c5130c09-5a1e-4a5f-901b-dd5a7f48818d","description":"

Datasets that read / write to destinations where a cluster of machines is managed, #Let's Data manages these machines in a Virtual Private Cloud (VPC). The vpc resource supports a vpc/list GET api to list a dataset's vpc details. The vpc also supports vpcPeeringConnections api sub resources to accept (create), list and delete vpc peering connections to the vpc.

\n","_postman_id":"c5130c09-5a1e-4a5f-901b-dd5a7f48818d"},{"name":"users","item":[{"name":"create","item":[{"name":"Create User","id":"12fac40f-46dd-4f67-94ba-79831625b8d3","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"body":{"mode":"raw","raw":"{\n \"tenantId\": \"tenantId\",\n \"createUserId\": \"userId\",\n \"emailAddress\": \"support@letsdata.io\",\n \"phone\": \"4751235468\",\n \"fullName\": \"#Let's Data Support\",\n \"userRole\": \"TenantUser\"\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/users/create","description":"

users/create - POST

Creates a new user in #Let's Data infrastructure in the logged in user's company (tenant). This user can then run datasets individually. The users/create POST requires a user data json file that has the details for the new user.

Input Parameters:

The POST body for a JSON request has the details about the user that needs to be created. This has the following schema:

{\n    \"tenantId\": \"String - The tenantId of the logged in user\",\n    \"createUserId\": \"String - The userId of the logged in user\",\n    \"emailAddress\": \"String - the email address of the new user that is being created\"\n    \"phone\": \"String - the user's phone number\"\n    \"fullName\": \"String - the user's full name\"\n    \"userRole\": \"The user's role - Allowed values: [TenantAdmin, TenantUser]\"\n}\n

Examples:

For example, a POST request to the users/create resource with the following body would create a new user with email address support@letsdata.io, fullName #Let's Data Support, and userRole TenantUser.

{\n    \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n    \"createUserId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n    \"emailAddress\": \"support@letsdata.io\"\n    \"phone\": \"4751235468\"\n    \"fullName\": \"#Let's Data Support\"\n    \"userRole\": \"TenantUser\"\n}\n

Output Parameters:

The HttpStatusCode of the response can be looked at to determine success / error. The response body is the JSON that has the following schema:

    {\n        statusCode: \"SUCCESS|ERROR|CONFLICT\"\n        message: \"details about the status code\"\n    }\n

statusCode: StatusCode of the request - this can be either SUCCESS or ERROR. In each of these cases, the Message string has additional details about the status.
message: The error / success message that has the details about the status of the request.

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

User create request has been successfully enqueued in the system and is currently being processed.

 {\n   \"statusCode\": \"SUCCESS\",\n   \"message\": \"We've received the create user request and are currently processing it. We'll send an email to the new user as soon as the create user request is completed\"\n }\n

Request was successfully enqueued

       {\n           \"statusCode\": \"SUCCESS\",\n           \"message\": \"<deleteType> request successfully enqueued.\"\n           \"updateDatasetComputeRequest\":\n           {\n             ... // the update compute request from the api call\n           }\n       }\n

409:

A create user request for this email address already exists in the system

  {\n      \"statusCode\": \"CONFLICT\",\n      \"message\": \"A create user request for this email address already exists in the system\"\n  }\n

500:

A create user request could not be created at this time. Please try again later.

      {\n          \"statusCode\": \"ERROR\",\n          \"message\": \"A create user request could not be created at this time. Please try again later.\"\n      }\n

An unexpected error has occurred.

      {\n          \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n          \"message\": \"Internal Server Error, please try again later.\"\n      }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).

Details:

It is important to note that the user creation is asynchronous. The users create enqueues the user creation request and the system then creates the user and send them an email with their credentials when the user has been created. You can use the users GET api to view the current status of the user request. The userStatus is set to CREATED and when the user creation has been enqueued and it is set to ACTIVE when its completed.

Docs

You can also learn all about Datasets at: https://www.letsdata.io/docs#users

\n","urlObject":{"path":["api","users","create"],"host":["https://www.letsdata.io"],"query":[],"variable":[]}},"response":[{"id":"dee48598-23ff-4768-bb6d-9e7881567fbf","name":"Example - Create User","originalRequest":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"body":{"mode":"raw","raw":"{\n \"tenantId\": \"tenantId\",\n \"createUserId\": \"userId\",\n \"emailAddress\": \"user1@letsdata.io\",\n \"phone\": \"4751235468\",\n \"fullName\": \"#Let's Data User1\",\n \"userRole\": \"TenantUser\"\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/users/create"},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:41:22 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"192"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"bdc2440b-c8ac-4fb7-8040-e96819e75568"},{"key":"x-amz-apigw-id","value":"Ubkk7ETsIAMEo_Q="},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee1aec-462620bf1455f3836c595d40"}],"cookie":[],"responseTime":null,"body":"{\n \"statusCode\": \"SUCCESS\",\n \"message\": \"We've received the create user request and are currently processing it. We'll send an email to the new user as soon as the create user request is completed\"\n}"}],"_postman_id":"12fac40f-46dd-4f67-94ba-79831625b8d3"}],"id":"b85e7040-483a-4d68-b4a7-12cd563f977e","_postman_id":"b85e7040-483a-4d68-b4a7-12cd563f977e","description":""},{"name":"delete","item":[{"name":"Delete User","id":"21b10204-3309-4b3d-8a40-ce0bd07cbcf4","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"body":{"mode":"raw","raw":"{\n\t\"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n\t\"deleteUserId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"emailAddress\": \"support@letsdata.io\"\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/users/delete","description":"

users/delete - POST

A user in #Let's Data can be deleted by using the users/delete POST api. This api available for the TenantAdmins only and requires the deleting user's email address. Only the user's database record is deleted and their login privileges revoked. Any datasets created by the user are not deleted. Use datasets/delete api to delete a user's datasets.

Input Parameters:

The POST body for a JSON request has the details about the user that needs to be created. This has the following schema:

{\n    \"tenantId\": \"String - The tenantId of the logged in user\",\n    \"deleteUserId\": \"String - The userId of the logged in user\",\n    \"emailAddress\": \"String - the email address of the new user that is being created\"\n}\n

Examples:

For example, a POST request to the users/delete resource with the following body would delete a user with email address support@letsdata.io.

{\n    \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n    \"deleteUserId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n    \"emailAddress\": \"support@letsdata.io\"\n}\n

Output Parameters:

The HttpStatusCode of the response can be looked at to determine success / error. The response body is the JSON that has the following schema:

    {\n        \"statusCode\": \"SUCCESS|SUCCESS_NO_OP|NOT_FOUND|ERROR\",\n        \"message\": \"details about the status code\"\n    }\n\n

statusCode: StatusCode of the request - this can be either SUCCESS, SUCCESS_NO_OP, NOT_FOUND or ERROR. In each of these cases, the Message string has additional details about the status. For example, if the stat is is SUCCESS_NO_OP, a message would tell the user that \"The user is already pending deletion\".
message: The error / success message that has the details about the status of the request.

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

User delete request has been successfully enqueued in the system and is currently being processed.

 {\n   \"statusCode\": \"SUCCESS\",\n   \"message\": \"We've received the delete user request and are currently processing it. User will be deleted soon\"\n }\n

The user is already pending deletion

       {\n           \"statusCode\": \"SUCCESS_NO_OP\",\n           \"message\": \"The user is already pending deletion\"\n       }\n

404:

A delete user request for this email address did not find a user in the system

  {\n      \"statusCode\": \"NOT_FOUND\",\n      \"message\": \"A delete user request for this email address did not find a user in the system\"\n  }\n

500:

The server encountered an internal error. Please try again

      {\n          \"statusCode\": \"ERROR\",\n          \"message\": \"The server encountered an internal error. Please try again\"\n      }\n

An unexpected error has occurred.

      {\n          \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n          \"message\": \"Internal Server Error, please try again later.\"\n      }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).

Details:

Deleting users in #Let's Data is an asynchronous operation. The users/delete POST api enqueues a deletion request and sets the user status to DELETING. You can use the users GET api to view the user deletion - a deleted user will return not found. Also note that a user deletion will delete the user's database record and revoke their login privileges. Any datasets that they created will not be deleted and should be deleted individually by using the datasets delete command.

Docs

You can also learn all about Datasets at: https://www.letsdata.io/docs#users

\n","urlObject":{"path":["api","users","delete"],"host":["https://www.letsdata.io"],"query":[],"variable":[]}},"response":[{"id":"762ce8aa-1ffb-46a4-8570-26c5eed67972","name":"Example - Delete User","originalRequest":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"body":{"mode":"raw","raw":"{\n\t\"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n\t\"deleteUserId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"emailAddress\": \"dev2tenant@theresonancelabs.com\"\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/users/delete"},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:40:38 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"134"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"18fc6522-147e-4a00-9178-cfe311ef0214"},{"key":"x-amz-apigw-id","value":"UbkfAEv2oAMEoAA="},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee1ac6-2a41f225758c99a569ba1957"}],"cookie":[],"responseTime":null,"body":"{\n \"statusCode\": \"SUCCESS\",\n \"message\": \"We've received the delete user request and are currently processing it. User will be deleted soon\"\n}"}],"_postman_id":"21b10204-3309-4b3d-8a40-ce0bd07cbcf4"}],"id":"e28d0eeb-6ea0-452e-b2d4-510c787f3074","_postman_id":"e28d0eeb-6ea0-452e-b2d4-510c787f3074","description":""},{"name":"list","item":[{"name":"List Users","id":"d12158e5-d274-455d-99c0-61b74b1e3df3","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/users/list?tenantId=tenantId&userId=userId","description":"

users/list - GET

The list of users in a company (tenant) can be obtained by using the users/list GET API. This returns a list of user details json and an optional next token to paginate the next page.

Input Parameters:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the the logged in user. For example, &userId=078260ed-3124-4de0-8eee-cc5b5025e7ad
limit: [Optional] The limit for the number of results that are to be returned by the command. This is used in conjunction with pagination when large number of records are being retrieved. This is optional and the system does set some meaningful defaults in most APIs. Also, this limit is a hint for the API and the results are not guaranteed to be exactly the same number as the limit. The user needs to handle the following cases when specifying limits:
- The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved.
- The records may be a little more than the limit (~<10 or so). User should handle these gracefully.\n Rule of thumb in using limits is to treat it as a soft max limit. For example, &limit=100
\n
next: [Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved. For example, &next=dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw%2B4MpoRCd%2F2eL3WaI2IHe3%2FbLYH%2F%2FgAYXtGXI01BZ5d5NwdWcVf7o5HGGpbvKibkd0zDfUUiJjI%2FaJQaSb2tM5mwflwszzdHuyNolNNtXwij1TjyGqLny2p0O5PquoYig8iq8YI%3D

Output Parameters:

The output is a JSON map that has the following sections:

    {\n        \"users\": [\n            {\n                ...\n            },\n            {\n                ...\n            },\n            ...\n        ],\n        \"next\": \"String\"\n    }\n

users: This is the list of user details json that are returned by the list command. Each user item has the following schema:

    {\n        \"fullName\": \"String\",\n        \"emailAddress\": \"String\",\n        \"phone\": \"String\",\n        \"userRole\": \"TenantAdmin|TenantUser\",\n        \"userStatus\": \"CREATED|ACTIVE|UPDATING|DELETING\",\n        \"tenantId\": \"String\",\n        \"userId\": \"String\",\n        \"createdBy\": \"String\",\n        \"createDatetime\": \"Long\",\n        \"updateDatetime\": \"Long\"\n    }\n

next: [Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved.

Actual Example Output:

Here is an actual example output for the command:

    {\n      \"next\": \"n7UZHPaQIuPpcqTaVhqBHIKk5EqvjzV7rMXWnXQri6bOth%2BpJf2oAKHAede3LonCehfba%2FXy0bDTzcI9gCRHdS9nQysgPHgyp%2Bt2q6NKsXFzD7xBrnoszW%2B%2FrOkCN%2B2XsUUuXgKToewQtkePPSWEFXj2uEhQKOyoJjxNvXt9PdASrka6N9jirCCu9S1PFeTmtLnJwEHOixcZvO5WyoW5J19TUbDEHS3nXOW46jmf%2BcOszSWz1AKPa58zo0OYmmCcCsJOOw3nwN8cK%2Bf8yzytWQ%3D%3D\",\n      \"users\": [\n        {\n          \"fullName\": \"#Let's Data Support\",\n          \"emailAddress\": \"support@letsdata.io\",\n          \"phone\": \"+14258028739\",\n          \"userRole\": \"TenantAdmin\",\n          \"userStatus\": \"ACTIVE\",\n          \"tenantId\": \"73160a84-4890-4ed9-95d1-f5e8b19658cd\",\n          \"userId\": \"9f645ac4-9041-4f80-86a8-5af28997431d\",\n          \"createdBy\": \"9f645ac4-9041-4f80-86a8-5af28997431d\",\n          \"createDatetime\": 1671588784592,\n          \"updateDatetime\": 1671588784592\n        }\n      ]\n    }\n

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

Request successfully retrieved the users.

{\n    \"users\": [\n        {\n            ...\n        },\n        {\n            ...\n        },\n        ...\n    ],\n    \"next\": \"String\"\n}\n

500:

An unexpected error has occurred.

          {\n          \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n          \"message\": \"Internal Server Error, please try again later.\"\n          }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).

Examples:

Example 1: list all users for the logged in user's company (tenant) - GET www.letsdata.io/api/users/list?tenantId=tenantId&userId=userId
Example 2: list all users for the logged in user's company (tenant), use the limit parameter to limit results to 100 users - GET www.letsdata.io/api/users/list?tenantId=tenantId&userId=userId&&limit=100
Example 3: list tasks for dataset IndexWebCrawlDataDec2022, paginate using the next token from prior call and limit the next page results by specifying limit - GET www.letsdata.io/api/users/list?tenantId=tenantId&userId=userId&limit=100&next=n7UZHPaQIuPpcqTaVhqBHIKk5EqvjzV7rMXWnXQri6bOth%2BpJf2oAKHAede3LonCehfba%2FXy0bDTzcI9gCRHdS9nQysgPHgyp%2Bt2q6NKsXFzD7xBrnoszW%2B%2FrOkCN%2B2XsUUuXgKToewQtkePPSWEFXj2uEhQKOyoJjxNvXt9PdASrka6N9jirCCu9S1PFeTmtLnJwEHOixcZvO5WyoW5J19TUbDEHS3nXOW46jmf%2BcOszSWz1AKPa58zo0OYmmCcCsJOOw3nwN8cK%2Bf8yzytWQ%3D%3D

Docs:

You can also learn all about Tasks at: https://www.letsdata.io/docs#users

\n","urlObject":{"path":["api","users","list"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

The userId of the logged in user

\n","type":"text/plain"},"key":"userId","value":"userId"},{"disabled":true,"description":{"content":"

\n","type":"text/plain"},"key":"limit","value":"10"},{"disabled":true,"description":{"content":"

\n","type":"text/plain"},"key":"next","value":"n7UZHPaQIuPpcqTaVhqBHIKk5EqvjzV7rMXWnXQri6bOth%2BpJf2oAKHAede3LonCehfba%2FXy0bDTzcI9gCRHdS9nQysgPHgyp%2Bt2q6NKsXFzD7xBrnoszW%2B%2FrOkCN%2B2XsUUuXgKToewQtkePPSWEFXj2uEhQKOyoJjxNvXt9PdASrka6N9jirCCu9S1PFeTmtLnJwEHOixcZvO5WyoW5J19TUbDEHS3nXOW46jmf%2BcOszSWz1AKPa58zo0OYmmCcCsJOOw3nwN8cK%2Bf8yzytWQ%3D%3D"}],"variable":[]}},"response":[{"id":"e078c39c-efc8-47c3-802a-27c031190bc0","name":"Example - List Users","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/users/list?tenantId=tenantId&userId=userId","host":["https://www.letsdata.io"],"path":["api","users","list"],"query":[{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"},{"key":"userId","value":"userId","description":"The userId of the logged in user "},{"key":"limit","value":"10","description":"[Optional] The limit for the number of results that are to be returned by the command. This is used in conjunction with pagination when large number of records are being retrieved. This is optional and the system does set some meaningful defaults in most APIs. Also, this limit is a hint for the API and the results are not guaranteed to be exactly the same number as the limit. The user needs to handle the following cases when specifying limits (Rule of thumb in using limits is to treat it as a soft max limit): * The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved. * The records may be a little more than the limit (\\~<10 or so). User should handle these gracefully.","disabled":true},{"key":"next","value":"n7UZHPaQIuPpcqTaVhqBHIKk5EqvjzV7rMXWnXQri6bOth%2BpJf2oAKHAede3LonCehfba%2FXy0bDTzcI9gCRHdS9nQysgPHgyp%2Bt2q6NKsXFzD7xBrnoszW%2B%2FrOkCN%2B2XsUUuXgKToewQtkePPSWEFXj2uEhQKOyoJjxNvXt9PdASrka6N9jirCCu9S1PFeTmtLnJwEHOixcZvO5WyoW5J19TUbDEHS3nXOW46jmf%2BcOszSWz1AKPa58zo0OYmmCcCsJOOw3nwN8cK%2Bf8yzytWQ%3D%3D","description":"[Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved. For example, &next =x3m2D9SduUj6...","type":"text","disabled":true}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:39:26 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"2705"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"2bb9f281-a1d5-4229-8fca-c52d67ef13b2"},{"key":"x-amz-apigw-id","value":"UbkS4FfboAMEmyg="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee1a78-2dcb708d74fb96ef51eb5026"}],"cookie":[],"responseTime":null,"body":"{\n \"loggedInUser\": {\n \"fullName\": \"USMAN SHAMI\",\n \"emailAddress\": \"usmanshami@letsdata.io\",\n \"phone\": \"4258028739\",\n \"userRole\": \"TenantAdmin\",\n \"userStatus\": \"ACTIVE\",\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"iamUserARN\": \"arn:aws:iam::223413462631:user/d5feaf90-71a9-41ee-b1b9-35e4242c3155-usmanshami@letsdata.io\",\n \"createdBy\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"createDatetime\": 1676298494168,\n \"updateDatetime\": 1676298494168\n },\n \"users\": [\n {\n \"fullName\": \"USMAN SHAMI\",\n \"emailAddress\": \"USMANSHAMI1@THERESONANCELABS.COM\",\n \"phone\": \"4258028739\",\n \"userRole\": \"TenantUser\",\n \"userStatus\": \"ACTIVE\",\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"395c6571-d85c-4b4a-8018-10230105bbf6\",\n \"iamUserARN\": \"arn:aws:iam::223413462631:user/d5feaf9071a941eeb1b935e4242c315555c08f8892088e16814db813c335ec78\",\n \"createdBy\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"createDatetime\": 1679781103732,\n \"updateDatetime\": 1679781868891\n },\n {\n \"fullName\": \"USMAN A. SHAMI\",\n \"emailAddress\": \"USMANSHAMI3@THERESONANCELABS.COM\",\n \"phone\": \"4258028739\",\n \"userRole\": \"TenantUser\",\n \"userStatus\": \"ACTIVE\",\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"a19a091b-31d4-4b8a-a106-bcc5e5f420b2\",\n \"iamUserARN\": \"arn:aws:iam::223413462631:user/d5feaf9071a941eeb1b935e4242c315595e4c6447f49eb5893989771c568cbc5\",\n \"createdBy\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"createDatetime\": 1679818959115,\n \"updateDatetime\": 1679819884440\n },\n {\n \"fullName\": \"USMAN SHAMI\",\n \"emailAddress\": \"dev1tenant@theresonancelabs.com\",\n \"phone\": \"4258028739\",\n \"userRole\": \"TenantUser\",\n \"userStatus\": \"CREATED\",\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"00000000-0000-0000-0000-000000000000\",\n \"iamUserARN\": \"NULL\",\n \"createdBy\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"createDatetime\": 1679678759000,\n \"updateDatetime\": 1679678759000\n },\n {\n \"fullName\": \"USMAN SHAMI\",\n \"emailAddress\": \"dev2tenant@theresonancelabs.com\",\n \"phone\": \"4258028739\",\n \"userRole\": \"TenantUser\",\n \"userStatus\": \"ACTIVE\",\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"626d5498-5d88-487a-8a69-c2ad2d72c945\",\n \"iamUserARN\": \"arn:aws:iam::223413462631:user/d5feaf9071a941eeb1b935e4242c3155d83efbd66968ebcb7b3286e92175e13b\",\n \"createdBy\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"createDatetime\": 1679679386316,\n \"updateDatetime\": 1679679402767\n },\n {\n \"fullName\": \"USMAN SHAMI\",\n \"emailAddress\": \"usmanshami@letsdata.io\",\n \"phone\": \"4258028739\",\n \"userRole\": \"TenantAdmin\",\n \"userStatus\": \"ACTIVE\",\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"iamUserARN\": \"arn:aws:iam::223413462631:user/d5feaf90-71a9-41ee-b1b9-35e4242c3155-usmanshami@letsdata.io\",\n \"createdBy\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"createDatetime\": 1676298494168,\n \"updateDatetime\": 1676298494168\n }\n ]\n}"}],"_postman_id":"d12158e5-d274-455d-99c0-61b74b1e3df3"}],"id":"6fe62c2b-60e8-4cd1-9a8d-5cd2cd739176","description":"

The listing of the users in a company can be obtained by using the users/list GET api. This api is available for the TenantAdmins only. This returns a list of the user details json and an optional next token to paginate the next page. The api also supports limit parameter that can be used to limit the results.

\n","_postman_id":"6fe62c2b-60e8-4cd1-9a8d-5cd2cd739176"},{"name":"update","item":[{"name":"Update User","id":"c850002f-773f-4302-8d90-691e228c915d","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"body":{"mode":"raw","raw":"{\n \"tenantId\":\"tenantId\",\n \"updateUserId\":\"userId\",\n \"emailAddress\": \"support@letsdata.io\",\n \"attributeToUpdate\": \"userRole\",\n \"attributeExistingValue\": \"TenantUser\",\n \"attributeNewValue\": \"TenantAdmin\"\n\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/users/update","description":"

users/update - POST

The user's details can be updated by the users/update POST API. We currently support updating the user's fullName, user's phone and the userRole. The command requires the updating user's email address, the name of the attribute that needs to be updated, the existing attribute value and the new value. This command is available to the TenantAdmins only.

Input Parameters:

The POST body for a JSON request has the details about the user that needs to be created. This has the following schema:

{\n    \"tenantId\": \"String - The tenantId of the logged in user\",\n    \"updateUserId\": \"String - The userId of the logged in user\",\n    \"emailAddress\": \"String - the email address of the new user that is being created\",\n    \"attributeToUpdate\": \"The user's attribute that is being updated. Value must be from these attributes that are currently supported for updates: phone, fullName, userRole\",\n    \"attributeExistingValue\": \"The existing value of the user attribute that is being updated\",\n    \"attributeNewValue\": \"The new value of the user attribute that is being updated.\"\n}\n

Examples:

For example, a POST request to the users/delete resource with the following body would delete a user with email address support@letsdata.io.

{\n    \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n    \"updateUserId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n    \"emailAddress\": \"support@letsdata.io\",\n    \"attributeToUpdate\": \"userRole\",\n    \"attributeExistingValue\": \"TenantUser\",\n    \"attributeNewValue\": \"TenantAdmin\"\n}\n

Output Parameters:

The HttpStatusCode of the response can be looked at to determine success / error. The response body is the JSON that has the following schema:

    {\n        \"statusCode\": \"SUCCESS|SUCCESS_NO_OP|NOT_FOUND|ERROR|CONFLICT\",\n        \"message\": \"details about the status code\"\n    }\n

statusCode: StatusCode of the request - this can be either SUCCESS, SUCCESS_NO_OP, NOT_FOUND, ERROR or CONFLICT. In each of these cases, the Message string has additional details about the status. For example, if the stat is is SUCCESS_NO_OP, a message would tell the user that \"The database record already seems to have been updated with the requested change.\".
message: The error / success message that has the details about the status of the request.

View the status of the request using users GET api

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

User was successfully updated

 {\n   \"statusCode\": \"SUCCESS\",\n   \"message\": \"User was successfully updated\"\n }\n

The database record already seems to have been updated with the requested change.

{\n    \"statusCode\": \"SUCCESS_NO_OP\",\n    \"message\": \"The database record already seems to have been updated with the requested change.\"\n}\n

404:

User was not found in the database

  {\n      \"statusCode\": \"NOT_FOUND\",\n      \"message\": \"User was not found in the database\"\n  }\n

409:

User request seems to be stale. User has been updated in the system. Please try again.

  {\n      \"statusCode\": \"CONFLICT\",\n      \"message\": \"User request seems to be stale. User has been updated in the system. Please try again.\"\n  }\n

500:

Error updating the user

      {\n          \"statusCode\": \"ERROR\",\n          \"message\": \"Error updating the user\"\n      }\n

Server encountered an unknown exception

      {\n          \"statusCode\": \"ERROR\",\n          \"message\": \"Server encountered an unknown exception\"\n      }\n

An unexpected error has occurred.

      {\n          \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n          \"message\": \"Internal Server Error, please try again later.\"\n      }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).

Docs

You can also learn all about Datasets at: https://www.letsdata.io/docs#users

\n","urlObject":{"path":["api","users","update"],"host":["https://www.letsdata.io"],"query":[],"variable":[]}},"response":[{"id":"0fc65b44-3b61-4805-a70a-0f0fe937abd7","name":"Example - Update User","originalRequest":{"method":"POST","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"body":{"mode":"raw","raw":"{\n \"tenantId\":\"tenantId\",\n \"updateUserId\":\"userId\",\n \"emailAddress\": \"support@letsdata.io\",\n \"attributeToUpdate\": \"userRole\",\n \"attributeExistingValue\": \"TenantUser\",\n \"attributeNewValue\": \"TenantAdmin\"\n\n}","options":{"raw":{"language":"json"}}},"url":"https://www.letsdata.io/api/users/update"},"status":"Not Found","code":404,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:38:53 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"73"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"146c953a-d71e-452a-94c2-7396e196a821"},{"key":"x-amz-apigw-id","value":"UbkN1Ho0IAMEauQ="},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee1a58-793e6056279d4f523dcb27bf"}],"cookie":[],"responseTime":null,"body":"{\n \"statusCode\": \"NOT_FOUND\",\n \"message\": \"User was not found in the database\"\n}"}],"_postman_id":"c850002f-773f-4302-8d90-691e228c915d"}],"id":"f141a9ee-1092-47f3-9a2e-24f84e5aee73","description":"

The user's details can be updated by a POST on the users/update API

\n","_postman_id":"f141a9ee-1092-47f3-9a2e-24f84e5aee73"},{"name":"View User","event":[{"listen":"test","script":{"id":"2f604618-db13-48dd-bfdb-4b14699c2a0e","exec":[""],"type":"text/javascript"}}],"id":"54ec1a44-72ae-41a0-9785-4b468125357c","request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/users?tenantId=tenantId&userId=userId&emailAddress=support@letsdata.io","description":"

users GET

Details about any user in #Let's Data can be viewed by using the users GET api. The api returns the details about the user. This api is used by TenantAdmins to view details about the different users in their company. TenantUsers can use this api to get the details about their user.

Input Parameters:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For example, &userId=078260ed-3124-4de0-8eee-cc5b5025e7ad
emailAddress: The email address of the user that is being updated / deleted. For example, &emailAddress=support@letsdata.io

Output Parameters:

The output is a JSON map that has the following sections:

    {\n        \"fullName\": \"String\",\n        \"emailAddress\": \"String\",\n        \"phone\": \"String\",\n        \"userRole\": \"TenantAdmin|TenantUser\",\n        \"userStatus\": \"CREATED|ACTIVE|UPDATING|DELETING\",\n        \"tenantId\": \"String\",\n        \"userId\": \"String\",\n        \"iamUserARN\": \"String\",\n        \"createdBy\": \"String\",\n        \"createDatetime\": \"Long\",\n        \"updateDatetime\": \"Long\"\n    }\n

Actual Example Output:

Here is an actual example output for the command:

    {\n      \"fullName\": \"#Let's Data Support\",\n      \"emailAddress\": \"support@letsdata.io\",\n      \"phone\": \"+144557155492\",\n      \"userRole\": \"TenantAdmin\",\n      \"userStatus\": \"ACTIVE\",\n      \"tenantId\": \"73160a84-4890-4ed9-95d1-f5e8b19658cd\",\n      \"userId\": \"9f645ac4-9041-4f80-86a8-5af28997431d\",\n      \"iamUserARN\": \"arn:aws:iam::223413462631:user/d5feaf9071a941eeb1b935e4242c315555c08f8892088e16814db813c335ec78\",\n      \"createdBy\": \"9f645ac4-9041-4f80-86a8-5af28997431d\",\n      \"createDatetime\": 1671588784592,\n      \"updateDatetime\": 1671588784592\n    }\n

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

Request successfully retrieved the user details.

{\n    \"fullName\": \"String\",\n    \"emailAddress\": \"String\",\n    \"phone\": \"String\",\n    \"userRole\": \"TenantAdmin|TenantUser\",\n    \"userStatus\": \"CREATED|ACTIVE|UPDATING|DELETING\",\n    \"tenantId\": \"String\",\n    \"userId\": \"String\",\n    \"iamUserARN\": \"String\",\n    \"createdBy\": \"String\",\n    \"createDatetime\": \"Long\",\n    \"updateDatetime\": \"Long\"\n}\n

401:

Users with userRole TenantUser can only view details about their user. Attempting to view details of different users will return 401 UNAUTHORIZED.

 {\n     \"statusCode\": \"UNAUTHORIZED\",\n     \"message\": \"Users with UserRole TenantUser are not authorized to other users in the organization\"\n }\n

404:

User with email address %s not found in the system

 {\n     \"statusCode\": \"NOT_FOUND\",\n     \"message\": \"User with email address %s not found in the system\"\n }\n

500:
- An unexpected error has occurred.
\n
```
 {\n     \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n     \"message\": \"Internal Server Error, please try again later.\"\n }\n
```
\n
- In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
\n

Examples:

Example 1: list the costs for the company - GET www.letsdata.io/api/costs?tenantId=tenantId&userId=userId
Example 2: list the costs, limit the results to 100 invoices - GET www.letsdata.io/api/costs?tenantId=tenantId&userId=userId&limit=100
Example 3: list the costs, paginate using the pagination tokens - GET www.letsdata.io/api/costs?tenantId=tenantId&userId=userId&next=in_1MPp74JcNeyq2GQYBxYwfdjn

Docs:

You can also learn all about Costs at: https://www.letsdata.io/docs#users

\n","urlObject":{"path":["api","users"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

\n","type":"text/plain"},"key":"userId","value":"userId"},{"description":{"content":"

The email address of the user that is being updated / deleted. For example, &emailAddress=support@letsdata.io

\n","type":"text/plain"},"key":"emailAddress","value":"support@letsdata.io"}],"variable":[]}},"response":[{"id":"7ec8dc66-61da-45d2-8dd7-f8470e6cfc2c","name":"Example - View User","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/users?tenantId=tenantId&userId=userId&emailAddress=usmanshami@letsdata.io","host":["https://www.letsdata.io"],"path":["api","users"],"query":[{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner."},{"key":"emailAddress","value":"usmanshami@letsdata.io","description":"The email address of the user that is being updated / deleted. For example, `&emailAddress=support@letsdata.io`"}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:36:51 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"451"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"7c8f5959-a730-403f-ba53-f3b11855bbe1"},{"key":"x-amz-apigw-id","value":"Ubj7nEAWIAMEqCg="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee19e3-0cd608295b276b274c5f4298"}],"cookie":[],"responseTime":null,"body":"{\n \"fullName\": \"USMAN SHAMI\",\n \"emailAddress\": \"usmanshami@letsdata.io\",\n \"phone\": \"4258028739\",\n \"userRole\": \"TenantAdmin\",\n \"userStatus\": \"ACTIVE\",\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"iamUserARN\": \"arn:aws:iam::223413462631:user/d5feaf90-71a9-41ee-b1b9-35e4242c3155-usmanshami@letsdata.io\",\n \"createdBy\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"createDatetime\": 1676298494168,\n \"updateDatetime\": 1676298494168\n}"}],"_postman_id":"54ec1a44-72ae-41a0-9785-4b468125357c"}],"id":"6ec5d1ce-fb0e-4213-bd9b-4e7af3079fd7","description":"

The administrator (TenantAdmin) for a company registered in #Let's Data can create different user accounts (login credentials in #Lets Data) for each user in the company. These users can be assigned administrator / user roles and can run datasets individually. #Let's Data also supports user management actions such as create, update and delete.

\n","_postman_id":"6ec5d1ce-fb0e-4213-bd9b-4e7af3079fd7"},{"name":"usagerecords","item":[{"name":"list","item":[{"name":"List Usage Records","id":"97405692-5117-4b01-9aea-f19e7c03d0f9","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/usagerecords/list?tenantId=tenantId&userId=userId&datasetName=CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20&limit=10&next=0giCKA5wDO0bENp0wwovRQkeirXcfgr3lhIZydjKIK%2B9Xr4B%2FJYhAXvgOiHBWgeimRFQ8IjnB9yBhpTGCbKkrtnxvFyHxJi%2BIUl8HLzTsuHHvvJtmonOzHkcRNo6I50l5HkyIiyHXLWnIZ%2B2IcgEQw%2FUsPnfKJXM2jya4XcT5GB0RCId066LOcWM4sz%2FL%2Fddw7i%2FjeoFQg2p6mBkmxbCXMTkRhkxzRp0Vw2%2FbxszetVY5%2BTbn3bJHpljhSbjXC9JUb9YXJmL4CB%2FZtmrlcBMxIJo57cY%2BDplox3WYaf0b2MmZCnx0rU7Jz1E0nHTxQu3%2FmFCFe1uSzJ8QajrHPmTWwX4HwIwSNsIlLwRIV03Zkn9IEkHTL41L%2B4Wxbk4PdeBx3P4WR9y7OFyysvITf0c1wTuK4yzBSVCgRACqm7WPEDQdy4XAzRzlWMVRi0RrcN%2FLbhOxiTzwBxvL6rVBNE2ipsLMMxDuhrCJqED72LzOOvNvje%2F2yJuh6lKwsKEYFsT1FW38uivf6MN0VVKh5LibbDThY%2FggG08ELKHuCIrnP%2BqvDTBjb9aLDs6j3Ux%2BYgLdKlp%2Fxl2janIvK%2FZls5n3ZPjRJo%2Fw0uqImdExEgjN4zgwo8xmEo1HmmgB%2F%2BMTimWrbNMHfUnjEJ76Fd3RM98DXWEP4UtdQxZomkf%2FUtBl5DxUIpF5JEh3F3dG2HXUz5w","description":"

usagerecords/list - GET

Use the usagerecords/list GET api to list the usage records created by #Let's Data to record the usage of the different AWS resources for the dataset execution. These are then used to determine the costs related to the dataset.

Input Parameters:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For example, &userId=078260ed-3124-4de0-8eee-cc5b5025e7ad
datasetName: The dataset name for the dataset that the user wants to run the command for. For example, &datasetName=IndexWebCrawlDataDec2022
limit: [Optional] The limit for the number of results that are to be returned by the command. This is used in conjunction with pagination when large number of records are being retrieved. This is optional and the system does set some meaningful defaults in most APIs. Also, this limit is a hint for the API and the results are not guaranteed to be exactly the same number as the limit. The user needs to handle the following cases when specifying limits:
- The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved.
- The records may be a little more than the limit (~<10 or so). User should handle these gracefully.
  Rule of thumb in using limits is to treat it as a soft max limit. For example, &limit=100
\n
next: [Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved. For example, &next=dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw+4MpoRCd/2eL3WaI2IHe3/bLYH//gAYXtGXI01BZ5d5NwdWcVf7o5HGGpbvKibkd0zDfUUiJjI/aJQaSb2tM5mwflwszzdHuyNolNNtXwij1TjyGqLny2p0O5PquoYig8iq8YI=

Output Parameters:

The output is a JSON map that has the following sections:

    {\n        \"usage\": [\n          {\n            ...\n          },\n          {\n            ...\n          },\n          ...\n        ],\n        \"next\": \"String\"\n    }\n\n

usage: This is the list of usage records json documents that are returned by the list command. These have the following schema:
``` json
{
\n
```
    \"tenantId\": \"String\",\n    \"userId\": \"Optional - appears when the usage record is for the user. For any company level resource usage without a user, this is absent\",\n    \"datasetName\": \"Optional - appears when the usage record is for the dataset. For any company level / user level resource usage without a dataset, this is absent\",\n    \"datasetId\": \"Optional - appears when the usage record is for the dataset. For any company level / user level resource usage without a dataset, this is absent\",\n    \"taskId\": \"Optional - appears when the usage record is for the dataset task. For any company level / user level / dataset level resource usage without a task, this is absent\",\n    \"meteringDimension\": \"ExecutionTime|StorageShardHour|PutRequests|GetRequests|S3TagStorage|TimedStorage\",\n    \"meteringUnit\": \"Seconds|ShardHours|Count|TagHours|ByteHours|...\",\n    \"meteringValue\": \"Float\",\n    \"resource\": \"Lambda|Kinesis|S3|...\",\n    \"resourceType\": \"Dataset|DatasetTask|DatasetWriteConnector|DatasetErrorConnector|...\",\n    \"eventStartTime\": \"Long\";\n    \"eventEndTime\": \"Long\",\n    \"billedStatus\": \"NOT_BILLED|BILLED|INTERNAL_ERROR|...\";\n    \"createDatetime\": \"Long\",\n    \"updateDatetime\": \"Long\"\n\n
```
}
``` json
Here is some explanation about the schema:
\n
- Optional attributes: Today, we meter only datasets resources for execution. We initialize the resources for dataset when its created and meter the resources during its lifecycle. This is because we do not have any substantial resources allocated at the user / company level. However, with additional scenarios, we can possibly start metering for company (tenant) resources and user resources. In such cases, the dataset and task related items may not appear in the company / user resource metering records records
- Resource + MeteringDimension + Metering Unit: Each AWS resource (example Kinesis) can be metered on multiple metering dimensions (StorageShardHour, PutRequests, GetRequests) and each of the metering dimensions for the resource has its own unit (ShardHours, Count, Count). See details for detailed list of these mappings
- ResourceType: ResourceType is the mapping of the resource to dataset's components - For example, an AWS S3 resource can be both a write destination and an error destination. (Resource, ResourceType) tuples disambiguates these - For example, (AWS S3, DatasetWriteConnector) and (AWS S3, DatasetErrorConnector)
- BilledStatus: The status of the usage record in the external billing system. NOT BILLED means its not yet been sent. BILLED is when the record has been sent to billing and processed successfully. INTERNAL_ERROR is different edge cases with billing that we are solving / fixing - in these cases we have not billed the usagerecord but we may do corrections etc.
\n
next: [Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved.
\n

Actual Example Output:

Here is an actual example output for the command:

     {\n        \"next\": \"0giCKA5wDO0bENp0wwovRQkeirXcfgr3lhIZydjKIK+9Xr4B/JYhAXvgOiHBWgei4fDnx2p0oGyuKx0wjqApZlOeYXaijTkAxoaQ4TSXXpsmWtUiKrwcn1R8G+yfo7LMydz2pPJXSOjjDxyDD9ZpEfAp9w4EUuGKfO2qhI+uIyDxs/Tn4ioZMEK4YbOj51BnGyIki0+0szz98EsxnlQYzb2JOagzz0BLTFAI3raL8v+ZEZjth7PuMM+X0jxh8b9FG7idmwheg9PdbryX7fNo5HCnX54U0i8eidL1SCNblJJh7dPU1fZ8RaLEZECmbtPT7KSFK5A8rhhhSr0fnxnj+eraCkT6x7hYa+/RYsIHQ5V8SRQ4nRpRXCxIsdbqc4TjwKG8ngzVLdSdBEmHk1uBIE4SylptTFOk93bz4C02+w89LjRwBZW3KeFEjKqfHVYzsNRAtwadkvObNKED7YbBP7yO1Su1sMjQa3q/H3ZuimGOBHbPxz8PRkdxNNRORHIcy+gyHgSbhJ4Lpbtbk5Lx8wEkBPs61VgOMdh3z1z05Ww0qxlVQcTogk5smhAIgVJGwF++GwCLfNqzD6keJUBSHvpHWfRee3+RcRUaY0itBt5FTpnkSVmLYSlckrG+m3vzvyP3XabMr0f1EgTTkJ+BmXGJ55p5I0cku2m6VwQmDgFRWvfn6almx/yKnVGlAlNGN5cF+TWKdewEq6I4lk7VNQ==\",\n        \"usage\":\n        [\n            {\n                  \"tenantId\": \"73160a84-4890-4ed9-95d1-f5e8b19658cd\",\n                  \"userId\": \"078260ed-3124-4de0-8eee-cc5b5025e7ad\",\n                  \"datasetName\": \"IndexWebCrawlDataDec2022\",\n                  \"datasetId\": \"d980bd53c402e9bf5ca067675d2a1bfd\",\n                  \"taskId\": \"343e3d5183e245695ba8e30ad62f5a60\",\n                  \"meteringDimension\": \"ExecutionTime\",\n                  \"meteringUnit\": \"Seconds\",\n                  \"meteringValue\": 309.0,\n                  \"resource\": \"Lambda\",\n                  \"resourceType\": \"DatasetTask\",\n                  \"eventStartTime\": 1672022358453,\n                  \"eventEndTime\": 1672022668153,\n                  \"billedStatus\": \"BILLED\",\n                  \"createDatetime\": 1672022671588,\n                  \"updateDatetime\": 1672022678107\n            },\n            {\n                  \"tenantId\": \"73160a84-4890-4ed9-95d1-f5e8b19658cd\",\n                  \"userId\": \"078260ed-3124-4de0-8eee-cc5b5025e7ad\",\n                  \"datasetName\": \"IndexWebCrawlDataDec2022\",\n                  \"datasetId\": \"d980bd53c402e9bf5ca067675d2a1bfd\",\n                  \"taskId\": \"343e3d5183e245695ba8e30ad62f5a60\",\n                  \"meteringDimension\": \"ExecutionTime\",\n                  \"meteringUnit\": \"Seconds\",\n                  \"meteringValue\": 309.0,\n                  \"resource\": \"Lambda\",\n                  \"resourceType\": \"DatasetTask\",\n                  \"eventStartTime\": 1672054465443,\n                  \"eventEndTime\": 1672054775304,\n                  \"billedStatus\": \"BILLED\",\n                  \"createDatetime\": 1672054775595,\n                  \"updateDatetime\": 1672054782009\n            },\n            {\n                  \"tenantId\": \"73160a84-4890-4ed9-95d1-f5e8b19658cd\",\n                  \"userId\": \"078260ed-3124-4de0-8eee-cc5b5025e7ad\",\n                  \"datasetName\": \"IndexWebCrawlDataDec2022\",\n                  \"datasetId\": \"d980bd53c402e9bf5ca067675d2a1bfd\",\n                  \"taskId\": \"343e3d5183e245695ba8e30ad62f5a60\",\n                  \"meteringDimension\": \"ExecutionTime\",\n                  \"meteringUnit\": \"Seconds\",\n                  \"meteringValue\": 310.0,\n                  \"resource\": \"Lambda\",\n                  \"resourceType\": \"DatasetTask\",\n                  \"eventStartTime\": 1672055364964,\n                  \"eventEndTime\": 1672055675558,\n                  \"billedStatus\": \"BILLED\",\n                  \"createDatetime\": 1672055682577,\n                  \"updateDatetime\": 1672055683397\n            }\n        ]\n    }\n\n

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

Request successfully retrieved the tasks for the dataset. The response body has the tasks, taskLogs and a next token for pagination.

      {\n          \"tasks\": [\n              ...\n          ],\n          \"taskLogs\": [\n              ...\n          ],\n          \"next\": \"...\"\n       }\n\n

404:

The dataset for the tenantId, userId and datasetName was not found in the database. An error code and error message is returned in the response JSON.
\n
```
      {\n        \"statusCode\": \"DATASET_NOT_FOUND\",\n        \"message\": \"Dataset not found in the database.\"\n      }\n\n
```
\n

The dataset has been deleted. Any task databases should have been deleted as well.

      {\n        \"statusCode\": \"DELETED\",\n        \"message\": \"datasetStatus is DELETED.\"\n      }\n\n

The dataset has been created but has not started processing yet, as such no tasks have yet been created. Wait for initialization to complete before retrying again.

      {\n        \"statusCode\": \"TASKS_NOT_YET_CREATED\",\n        \"message\": \"datasetStatus is CREATED, tasks have not been created yet. Wait for dataset initialization to complete and retry.\"\n      }\n\n

The dataset exists but hasn't been completely initialized yet, as such no tasks have yet been created. Wait for initialization to complete before retrying again.

      {\n        \"statusCode\": \"TASKS_NOT_YET_CREATED\",\n        \"message\": \"datasetStatus is INITIALIZING, tasks have not been created yet. Wait for dataset initialization to complete and retry.\"\n      }\n\n

500:

An unexpected error has occurred.

              {\n              \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n              \"message\": \"Internal Server Error, please try again later.\"\n              }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
\n

Details

#Let's Data charges are usage based - there are no upfront fees, hidden costs, recurring charges or service minimums.

As the datasets execute, their resource usage is calculated, costed and added to the customer's invoice. The invoice is charged at the end of the billing cycle.

Cost Types

These resources start accruing costs as soon as they are created. The costs can be classified into two categories: 1./ Use-time cost 2./ Recurring costs

Use-Time Costs: Use-time costs are costs that accrue when the resources are being used. If the resources are not being used, these costs do not add up. For example, Lambda compute duration costs only for the time the lambda function was running. If the function is not running, there would be no costs. Similar examples are Requests per second, Bytes Transferred per second etc.
Recurring Costs: Recurring costs are costs that keep on adding up as long as the resource remains initialized. For example, a kinesis stream's Shard-hours costs are such an example - every hour the kinesis shards size is calculated and costed. Even if the dataset is complete and no data is being written / read from the kinesis stream, the Shard-hours costs keep adding up. Similar examples are S3 Bucket Storage Bytes, Dynamo DB Storage Bytes etc.

Usage Types and Pricing

The following lists example pricing at a glance. For example, these service usages maybe charged for a dataset execution. For a complete list of resources, dimensions and their latest, up to date pricing, see the https://www.letsdata.io/pricing page.

+---------------------------------------+------------------------------------+------------------------+------------------------+--------------------+\n| Metering Resource                     |     Metering Dimension             |    Metering Unit       |   Price per unit       |  Cost Type         |\n+---------------------------------------+------------------------------------+------------------------+------------------------+--------------------+\n| Lambda                                |     ExecutionTime                  |    Seconds             |   $ 0.00000333334      |  Use-Time Cost     |\n| Lambda                                |     ExecutionRequests              |    Count               |   TBA                  |  Use-Time Cost     |\n| Kinesis                               |     PutRequests                    |    Count               |   $ 0.000000028        |  Use-Time Cost     |\n| Kinesis                               |     GetRequests                    |    Count               |   TBA                  |  Use-Time Cost     |\n| Kinesis                               |     StorageShardHour               |    ShardHours          |   $ 0.03               |  Recurring Costs   |\n| S3                                    |     S3TagStorage                   |    TagHours            |   $ 0.000000021        |  Recurring Costs   |\n| S3                                    |     TimedStorage                   |    ByteHours           |   $ 0.000000021        |  Recurring Costs   |\n| S3                                    |     Requests (All Tiers)           |    Count               |   TBA                  |  Use-Time Cost     |\n+---------------------------------------+------------------------------------+------------------------+------------------------+--------------------+\nSystem's Internal Usage:\n+---------------------------------------+------------------------------------+------------------------+------------------------+--------------------+\n| Metering Resource                     |     Metering Dimension             |    Metering Unit       |   Price per unit       |  Cost Type         |\n+---------------------------------------+------------------------------------+------------------------+------------------------+--------------------+\n| DynamoDB                              |     ReadCapacityUnit               |    RCU                 |   TBA                  |  Recurring Costs   |\n| DynamoDB                              |     WriteCapacityUnit              |    WCU                 |   TBA                  |  Recurring Costs   |\n| DynamoDB                              |     TimedStorage                   |    ByteHours           |   TBA                  |  Recurring Costs   |\n| SQS                                   |     Requests                       |    Count               |   TBA                  |  Use-Time Cost     |\n| CodeBuild                             |     BuildMinutes                   |    Minutes             |   TBA                  |  Use-Time Cost     |\n+---------------------------------------+------------------------------------+------------------------+------------------------+--------------------+\n\n

Cost Management

Considering that our datasets are active for a finite amount of time, it makes sense to reclaim any resources that were initialized for the dataset processing but are not being used anymore since the dataset has COMPLETED /ERRORED. A notable exception to these is data in the write connectors / error connectors that may still be used by the external applications. If these unused resources are not reclaimed, they can easily add up to the costs for the dataset and result in a larger than expected billed amount. Learn about Costs Management in #Let's Data at: https://www.letsdata.io/docs#costsmanagement

Examples:

Example 1: View dataset IndexWebCrawlDataDec2022 usage records - GET www.letsdata.io/api/usagerecords/list?tenantId=tenantId&userId=userId&&datasetName=IndexWebCrawlDataDec2022
Example 2: View usage records for the dataset IndexWebCrawlDataDec2022 created by the user '078260ed-3124-4de0-8eee-cc5b5025e7ad' - GET www.letsdata.io/api/usagerecords/list?tenantId=tenantId&userId=078260ed-3124-4de0-8eee-cc5b5025e7ad&&datasetName=IndexWebCrawlDataDec2022
Example 3: View dataset IndexWebCrawlDataDec2022 usage records, limit results to 100 records - GET www.letsdata.io/api/usagerecords/list?tenantId=tenantId&userId=userId&&datasetName=IndexWebCrawlDataDec2022&limit=100
Example 4: View dataset IndexWebCrawlDataDec2022 usage records, limit results to 100 records and paginate using next token - GET www.letsdata.io/api/usagerecords/list?tenantId=tenantId&userId=userId&&datasetName=IndexWebCrawlDataDec2022&limit=100&next=0giCKA5wDO0bENp0wwovRQkeirXcfgr3lhIZydjKIK...

Docs:

You can also learn all about UsageRecords & Billing at: https://www.letsdata.io/docs#billing
You can also learn about Costs Management in #Let's Data at: https://www.letsdata.io/docs#costsmanagement

\n","urlObject":{"path":["api","usagerecords","list"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

\n","type":"text/plain"},"key":"userId","value":"userId"},{"description":{"content":"

The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022

\n","type":"text/plain"},"key":"datasetName","value":"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20"},{"description":{"content":"

The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved.
The records may be a little more than the limit (~<10 or so). User should handle these gracefully.\n Rule of thumb in using limits is to treat it as a soft max limit. For example, &limit=100

\n","type":"text/plain"},"key":"limit","value":"10"},{"description":{"content":"

\n","type":"text/plain"},"key":"next","value":"0giCKA5wDO0bENp0wwovRQkeirXcfgr3lhIZydjKIK%2B9Xr4B%2FJYhAXvgOiHBWgeimRFQ8IjnB9yBhpTGCbKkrtnxvFyHxJi%2BIUl8HLzTsuHHvvJtmonOzHkcRNo6I50l5HkyIiyHXLWnIZ%2B2IcgEQw%2FUsPnfKJXM2jya4XcT5GB0RCId066LOcWM4sz%2FL%2Fddw7i%2FjeoFQg2p6mBkmxbCXMTkRhkxzRp0Vw2%2FbxszetVY5%2BTbn3bJHpljhSbjXC9JUb9YXJmL4CB%2FZtmrlcBMxIJo57cY%2BDplox3WYaf0b2MmZCnx0rU7Jz1E0nHTxQu3%2FmFCFe1uSzJ8QajrHPmTWwX4HwIwSNsIlLwRIV03Zkn9IEkHTL41L%2B4Wxbk4PdeBx3P4WR9y7OFyysvITf0c1wTuK4yzBSVCgRACqm7WPEDQdy4XAzRzlWMVRi0RrcN%2FLbhOxiTzwBxvL6rVBNE2ipsLMMxDuhrCJqED72LzOOvNvje%2F2yJuh6lKwsKEYFsT1FW38uivf6MN0VVKh5LibbDThY%2FggG08ELKHuCIrnP%2BqvDTBjb9aLDs6j3Ux%2BYgLdKlp%2Fxl2janIvK%2FZls5n3ZPjRJo%2Fw0uqImdExEgjN4zgwo8xmEo1HmmgB%2F%2BMTimWrbNMHfUnjEJ76Fd3RM98DXWEP4UtdQxZomkf%2FUtBl5DxUIpF5JEh3F3dG2HXUz5w"}],"variable":[]}},"response":[{"id":"a95c2a37-fd53-4951-8ef4-154ae56317db","name":"Example - List Usage Records","originalRequest":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"The IdToken in \"Bearer \\{\\{IdToken\\}\\}\" format","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"The AccessToken in \"Bearer \\{\\{AccessToken\\}\\}\" format","type":"text"}],"url":{"raw":"https://www.letsdata.io/api/usagerecords/list?tenantId=tenantId&userId=userId&datasetName=CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20","host":["https://www.letsdata.io"],"path":["api","usagerecords","list"],"query":[{"key":"tenantId","value":"tenantId","description":"The tenantId of the logged in user"},{"key":"userId","value":"userId","description":"The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner."},{"key":"datasetName","value":"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20","description":"The dataset name for the dataset that the user wants to run the command for. For Example, IndexWebCrawlDataDec2022"},{"key":"limit","value":"10","description":"[Optional] The limit for the number of results that are to be returned by the command. This is used in conjunction with pagination when large number of records are being retrieved. This is optional and the system does set some meaningful defaults in most APIs. Also, this limit is a hint for the API and the results are not guaranteed to be exactly the same number as the limit. The user needs to handle the following cases when specifying limits:\n - The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved.\n - The records may be a little more than the limit (~<10 or so). User should handle these gracefully.\n Rule of thumb in using limits is to treat it as a soft max limit. For example, `&limit=100`","disabled":true},{"key":"next","value":"0giCKA5wDO0bENp0wwovRQkeirXcfgr3lhIZydjKIK%2B9Xr4B%2FJYhAXvgOiHBWgeimRFQ8IjnB9yBhpTGCbKkrtnxvFyHxJi%2BIUl8HLzTsuHHvvJtmonOzHkcRNo6I50l5HkyIiyHXLWnIZ%2B2IcgEQw%2FUsPnfKJXM2jya4XcT5GB0RCId066LOcWM4sz%2FL%2Fddw7i%2FjeoFQg2p6mBkmxbCXMTkRhkxzRp0Vw2%2FbxszetVY5%2BTbn3bJHpljhSbjXC9JUb9YXJmL4CB%2FZtmrlcBMxIJo57cY%2BDplox3WYaf0b2MmZCnx0rU7Jz1E0nHTxQu3%2FmFCFe1uSzJ8QajrHPmTWwX4HwIwSNsIlLwRIV03Zkn9IEkHTL41L%2B4Wxbk4PdeBx3P4WR9y7OFyysvITf0c1wTuK4yzBSVCgRACqm7WPEDQdy4XAzRzlWMVRi0RrcN%2FLbhOxiTzwBxvL6rVBNE2ipsLMMxDuhrCJqED72LzOOvNvje%2F2yJuh6lKwsKEYFsT1FW38uivf6MN0VVKh5LibbDThY%2FggG08ELKHuCIrnP%2BqvDTBjb9aLDs6j3Ux%2BYgLdKlp%2Fxl2janIvK%2FZls5n3ZPjRJo%2Fw0uqImdExEgjN4zgwo8xmEo1HmmgB%2F%2BMTimWrbNMHfUnjEJ76Fd3RM98DXWEP4UtdQxZomkf%2FUtBl5DxUIpF5JEh3F3dG2HXUz5w","description":"[Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved. For example, `&next=dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw%2B4MpoRCd%2F2eL3WaI2IHe3%2FbLYH%2F%2FgAYXtGXI01BZ5d5NwdWcVf7o5HGGpbvKibkd0zDfUUiJjI%2FaJQaSb2tM5mwflwszzdHuyNolNNtXwij1TjyGqLny2p0O5PquoYig8iq8YI%3D`","disabled":true}]}},"status":"OK","code":200,"_postman_previewlanguage":"json","header":[{"key":"Date","value":"Sun, 10 Mar 2024 20:18:03 GMT"},{"key":"Content-Type","value":"application/json"},{"key":"Content-Length","value":"66973"},{"key":"Connection","value":"keep-alive"},{"key":"x-amzn-RequestId","value":"3149d8d5-07f2-45c1-a2c4-25167902adb0"},{"key":"x-amz-apigw-id","value":"UbhLRGptIAMEruw="},{"key":"x-custom-header","value":"custom header"},{"key":"X-Amzn-Trace-Id","value":"Root=1-65ee157b-12c3ebc73fd9326b4a0c4b66"}],"cookie":[],"responseTime":null,"body":"{\n \"next\": null,\n \"usage\": [\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"computeEngineType\": \"LAMBDA\",\n \"meteringDimension\": \"DataProcessing\",\n \"meteringUnit\": \"GB\",\n \"meteringValue\": 0.0673822621,\n \"resource\": \"Cloudwatch\",\n \"resourceType\": \"DatasetCompute\",\n \"eventStartTime\": 1702425600000,\n \"eventEndTime\": 1702512000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 10.10733931500000098990810215582314413,\n \"meteringQuantity\": 10,\n \"priceId\": \"price_1MWmCMJcNeyq2GQYTpc3GXEI\",\n \"price\": 150\n },\n \"createDatetime\": 1707513908068,\n \"updateDatetime\": 1707516561881\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"computeEngineType\": \"LAMBDA\",\n \"meteringDimension\": \"ExecutionTime\",\n \"meteringUnit\": \"Seconds\",\n \"meteringValue\": 9787.11,\n \"resource\": \"Lambda\",\n \"resourceType\": \"DatasetCompute\",\n \"eventStartTime\": 1702425600000,\n \"eventEndTime\": 1702512000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 48.935647871100002910388866439461708068,\n \"meteringQuantity\": 48,\n \"priceId\": \"price_1MWmCLJcNeyq2GQYXNd93fwp\",\n \"price\": 0.00500001\n },\n \"createDatetime\": 1707513908053,\n \"updateDatetime\": 1707516561636\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"computeEngineType\": \"LAMBDA\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 5887,\n \"resource\": \"Lambda\",\n \"resourceType\": \"DatasetCompute\",\n \"eventStartTime\": 1702425600000,\n \"eventEndTime\": 1702512000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.35322,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCMJcNeyq2GQY1RGuIxPK\",\n \"price\": 0.00006\n },\n \"createDatetime\": 1707513908058,\n \"updateDatetime\": 1707516561676\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"Queuing\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 1383,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702425600000,\n \"eventEndTime\": 1702512000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.20745,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlvJcNeyq2GQYncceSQcv\",\n \"price\": 0.00015\n },\n \"createDatetime\": 1707513908650,\n \"updateDatetime\": 1707516569575\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"Queuing\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 753,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702512000000,\n \"eventEndTime\": 1702598400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.11295,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlvJcNeyq2GQYncceSQcv\",\n \"price\": 0.00015\n },\n \"createDatetime\": 1707513908651,\n \"updateDatetime\": 1707516569746\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"Queuing\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 575,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702598400000,\n \"eventEndTime\": 1702684800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.08625,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlvJcNeyq2GQYncceSQcv\",\n \"price\": 0.00015\n },\n \"createDatetime\": 1707513908650,\n \"updateDatetime\": 1707516569633\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"Queuing\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 574,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702684800000,\n \"eventEndTime\": 1702771200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0861,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlvJcNeyq2GQYncceSQcv\",\n \"price\": 0.00015\n },\n \"createDatetime\": 1707513908651,\n \"updateDatetime\": 1707516578225\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"Queuing\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 573,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702771200000,\n \"eventEndTime\": 1702857600000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.08595,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlvJcNeyq2GQYncceSQcv\",\n \"price\": 0.00015\n },\n \"createDatetime\": 1707513908650,\n \"updateDatetime\": 1707516569662\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"Queuing\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 571,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702857600000,\n \"eventEndTime\": 1702944000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.08565,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlvJcNeyq2GQYncceSQcv\",\n \"price\": 0.00015\n },\n \"createDatetime\": 1707513908650,\n \"updateDatetime\": 1707516561917\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"Queuing\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 572,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702944000000,\n \"eventEndTime\": 1703030400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0858,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlvJcNeyq2GQYncceSQcv\",\n \"price\": 0.00015\n },\n \"createDatetime\": 1707513908651,\n \"updateDatetime\": 1707516578146\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"Queuing\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 574,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703030400000,\n \"eventEndTime\": 1703116800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0861,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlvJcNeyq2GQYncceSQcv\",\n \"price\": 0.00015\n },\n \"createDatetime\": 1707513908650,\n \"updateDatetime\": 1707516569549\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"Queuing\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 574,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703116800000,\n \"eventEndTime\": 1703203200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0861,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlvJcNeyq2GQYncceSQcv\",\n \"price\": 0.00015\n },\n \"createDatetime\": 1707513908651,\n \"updateDatetime\": 1707516578170\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"Queuing\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 574,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703203200000,\n \"eventEndTime\": 1703289600000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0861,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlvJcNeyq2GQYncceSQcv\",\n \"price\": 0.00015\n },\n \"createDatetime\": 1707513908650,\n \"updateDatetime\": 1707516569688\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"Queuing\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 574,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703289600000,\n \"eventEndTime\": 1703376000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0861,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlvJcNeyq2GQYncceSQcv\",\n \"price\": 0.00015\n },\n \"createDatetime\": 1707513908651,\n \"updateDatetime\": 1707516578198\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"Queuing\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 573,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703376000000,\n \"eventEndTime\": 1703462400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.08595,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlvJcNeyq2GQYncceSQcv\",\n \"price\": 0.00015\n },\n \"createDatetime\": 1707513908651,\n \"updateDatetime\": 1707516569717\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"Queuing\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 573,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703462400000,\n \"eventEndTime\": 1703548800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.08595,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlvJcNeyq2GQYncceSQcv\",\n \"price\": 0.00015\n },\n \"createDatetime\": 1707513908650,\n \"updateDatetime\": 1707516569603\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"Queuing\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 572,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703548800000,\n \"eventEndTime\": 1703635200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0858,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlvJcNeyq2GQYncceSQcv\",\n \"price\": 0.00015\n },\n \"createDatetime\": 1707513908651,\n \"updateDatetime\": 1707516578117\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 11,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1702425600000,\n \"eventEndTime\": 1702512000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0165,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCIJcNeyq2GQYo5PrkvIv\",\n \"price\": 0.0015\n },\n \"createDatetime\": 1707513905451,\n \"updateDatetime\": 1707516561162\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 8,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1703376000000,\n \"eventEndTime\": 1703462400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.012,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCIJcNeyq2GQYo5PrkvIv\",\n \"price\": 0.0015\n },\n \"createDatetime\": 1707513905452,\n \"updateDatetime\": 1707516561193\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"S3TagStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 0.1290322581,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1702512000000,\n \"eventEndTime\": 1702598400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000038709677429999997388954113830550340935,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKaVo0cNs\",\n \"price\": 0.0003\n },\n \"createDatetime\": 1707513905449,\n \"updateDatetime\": 1707516553753\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"S3TagStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 0.1290322581,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1702598400000,\n \"eventEndTime\": 1702684800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000038709677429999997388954113830550340935,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKaVo0cNs\",\n \"price\": 0.0003\n },\n \"createDatetime\": 1707513905437,\n \"updateDatetime\": 1707516546794\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"S3TagStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 0.1290322581,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1702684800000,\n \"eventEndTime\": 1702771200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000038709677429999997388954113830550340935,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKaVo0cNs\",\n \"price\": 0.0003\n },\n \"createDatetime\": 1707513905447,\n \"updateDatetime\": 1707516553670\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"S3TagStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 0.1290322581,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1702771200000,\n \"eventEndTime\": 1702857600000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000038709677429999997388954113830550340935,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKaVo0cNs\",\n \"price\": 0.0003\n },\n \"createDatetime\": 1707513905449,\n \"updateDatetime\": 1707516553727\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"S3TagStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 0.1290322581,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1702857600000,\n \"eventEndTime\": 1702944000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000038709677429999997388954113830550340935,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKaVo0cNs\",\n \"price\": 0.0003\n },\n \"createDatetime\": 1707513905438,\n \"updateDatetime\": 1707516546896\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"S3TagStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 0.1290322581,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1702944000000,\n \"eventEndTime\": 1703030400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000038709677429999997388954113830550340935,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKaVo0cNs\",\n \"price\": 0.0003\n },\n \"createDatetime\": 1707513905449,\n \"updateDatetime\": 1707516553777\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"S3TagStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 0.1290322581,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1703030400000,\n \"eventEndTime\": 1703116800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000038709677429999997388954113830550340935,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKaVo0cNs\",\n \"price\": 0.0003\n },\n \"createDatetime\": 1707513905437,\n \"updateDatetime\": 1707516546823\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"S3TagStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 0.1290322581,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1703116800000,\n \"eventEndTime\": 1703203200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000038709677429999997388954113830550340935,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKaVo0cNs\",\n \"price\": 0.0003\n },\n \"createDatetime\": 1707513905446,\n \"updateDatetime\": 1707516553609\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"S3TagStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 0.1290322581,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1703203200000,\n \"eventEndTime\": 1703289600000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000038709677429999997388954113830550340935,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKaVo0cNs\",\n \"price\": 0.0003\n },\n \"createDatetime\": 1707513905437,\n \"updateDatetime\": 1707516546858\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"S3TagStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 0.1290322581,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1703289600000,\n \"eventEndTime\": 1703376000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000038709677429999997388954113830550340935,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKaVo0cNs\",\n \"price\": 0.0003\n },\n \"createDatetime\": 1707513905438,\n \"updateDatetime\": 1707516546928\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"S3TagStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 0.1290322581,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1703376000000,\n \"eventEndTime\": 1703462400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000038709677429999997388954113830550340935,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKaVo0cNs\",\n \"price\": 0.0003\n },\n \"createDatetime\": 1707513905447,\n \"updateDatetime\": 1707516553698\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"S3TagStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 0.1290322581,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1703462400000,\n \"eventEndTime\": 1703548800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000038709677429999997388954113830550340935,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKaVo0cNs\",\n \"price\": 0.0003\n },\n \"createDatetime\": 1707513905438,\n \"updateDatetime\": 1707516553577\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"S3TagStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 0.1290322581,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1703548800000,\n \"eventEndTime\": 1703635200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000038709677429999997388954113830550340935,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKaVo0cNs\",\n \"price\": 0.0003\n },\n \"createDatetime\": 1707513905447,\n \"updateDatetime\": 1707516553641\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.56e-7,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1702512000000,\n \"eventEndTime\": 1702598400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0000010763999999999999585965267394523092736,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKbpBt0Lx\",\n \"price\": 6.9\n },\n \"createDatetime\": 1707513905436,\n \"updateDatetime\": 1707516539256\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.56e-7,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1702598400000,\n \"eventEndTime\": 1702684800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0000010763999999999999585965267394523092736,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKbpBt0Lx\",\n \"price\": 6.9\n },\n \"createDatetime\": 1707513905436,\n \"updateDatetime\": 1707516539193\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.56e-7,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1702684800000,\n \"eventEndTime\": 1702771200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0000010763999999999999585965267394523092736,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKbpBt0Lx\",\n \"price\": 6.9\n },\n \"createDatetime\": 1707513905431,\n \"updateDatetime\": 1707516531354\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.56e-7,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1702771200000,\n \"eventEndTime\": 1702857600000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0000010763999999999999585965267394523092736,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKbpBt0Lx\",\n \"price\": 6.9\n },\n \"createDatetime\": 1707513905435,\n \"updateDatetime\": 1707516539166\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.56e-7,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1702857600000,\n \"eventEndTime\": 1702944000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0000010763999999999999585965267394523092736,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKbpBt0Lx\",\n \"price\": 6.9\n },\n \"createDatetime\": 1707513905435,\n \"updateDatetime\": 1707516539087\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.56e-7,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1702944000000,\n \"eventEndTime\": 1703030400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0000010763999999999999585965267394523092736,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKbpBt0Lx\",\n \"price\": 6.9\n },\n \"createDatetime\": 1707513905436,\n \"updateDatetime\": 1707516539229\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.56e-7,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1703030400000,\n \"eventEndTime\": 1703116800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0000010763999999999999585965267394523092736,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKbpBt0Lx\",\n \"price\": 6.9\n },\n \"createDatetime\": 1707513905435,\n \"updateDatetime\": 1707516539057\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.56e-7,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1703116800000,\n \"eventEndTime\": 1703203200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0000010763999999999999585965267394523092736,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKbpBt0Lx\",\n \"price\": 6.9\n },\n \"createDatetime\": 1707513905434,\n \"updateDatetime\": 1707516531409\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.56e-7,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1703203200000,\n \"eventEndTime\": 1703289600000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0000010763999999999999585965267394523092736,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKbpBt0Lx\",\n \"price\": 6.9\n },\n \"createDatetime\": 1707513905435,\n \"updateDatetime\": 1707516539140\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.56e-7,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1703289600000,\n \"eventEndTime\": 1703376000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0000010763999999999999585965267394523092736,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKbpBt0Lx\",\n \"price\": 6.9\n },\n \"createDatetime\": 1707513905434,\n \"updateDatetime\": 1707516531381\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.56e-7,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1703376000000,\n \"eventEndTime\": 1703462400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0000010763999999999999585965267394523092736,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKbpBt0Lx\",\n \"price\": 6.9\n },\n \"createDatetime\": 1707513905436,\n \"updateDatetime\": 1707516546769\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.56e-7,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1703462400000,\n \"eventEndTime\": 1703548800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0000010763999999999999585965267394523092736,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKbpBt0Lx\",\n \"price\": 6.9\n },\n \"createDatetime\": 1707513905435,\n \"updateDatetime\": 1707516531431\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"S3\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldec8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.56e-7,\n \"resource\": \"S3\",\n \"resourceType\": \"DatasetErrorConnector\",\n \"eventStartTime\": 1703548800000,\n \"eventEndTime\": 1703635200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0000010763999999999999585965267394523092736,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmCGJcNeyq2GQYKbpBt0Lx\",\n \"price\": 6.9\n },\n \"createDatetime\": 1707513905436,\n \"updateDatetime\": 1707516546745\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"SQS\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldwc8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"DataTransferOut\",\n \"meteringUnit\": \"GB\",\n \"meteringValue\": 0.0000772942,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetWriteConnector\",\n \"eventStartTime\": 1702425600000,\n \"eventEndTime\": 1702512000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0020869433999999998909308587813349333828,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MZOlGJcNeyq2GQY8l0JxjoC\",\n \"price\": 27\n },\n \"createDatetime\": 1707513907844,\n \"updateDatetime\": 1707516561429\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"connectorDestinations\": \"SQS\",\n \"resourceLocation\": \"LetsData\",\n \"resourceArn\": \"tldwc8e04743d71815b7867a915c5da514db6\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 138,\n \"resource\": \"SQS\",\n \"resourceType\": \"DatasetWriteConnector\",\n \"eventStartTime\": 1702425600000,\n \"eventEndTime\": 1702512000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.0207,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5b1dJcNeyq2GQYym5PNVoT\",\n \"price\": 0.00015\n },\n \"createDatetime\": 1707513907843,\n \"updateDatetime\": 1707516561225\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskManagement\",\n \"meteringDimension\": \"ExecutionTime\",\n \"meteringUnit\": \"Seconds\",\n \"meteringValue\": 212.437,\n \"resource\": \"Lambda\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702425600000,\n \"eventEndTime\": 1702512000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 1.0621871243700000591172738495515659451,\n \"meteringQuantity\": 1,\n \"priceId\": \"price_1MWmExJcNeyq2GQYSbCNLVt9\",\n \"price\": 0.00500001\n },\n \"createDatetime\": 1707513923370,\n \"updateDatetime\": 1707516629516\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskManagement\",\n \"meteringDimension\": \"ExecutionTime\",\n \"meteringUnit\": \"Seconds\",\n \"meteringValue\": 58.427,\n \"resource\": \"Lambda\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702512000000,\n \"eventEndTime\": 1702598400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.29213558426999999801047636083239922299,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmExJcNeyq2GQYSbCNLVt9\",\n \"price\": 0.00500001\n },\n \"createDatetime\": 1707513923370,\n \"updateDatetime\": 1707516629543\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskManagement\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 4106,\n \"resource\": \"Lambda\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702425600000,\n \"eventEndTime\": 1702512000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.24636,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmEyJcNeyq2GQYRKdMNpmf\",\n \"price\": 0.00006\n },\n \"createDatetime\": 1707513923372,\n \"updateDatetime\": 1707516629600\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskManagement\",\n \"meteringDimension\": \"Requests\",\n \"meteringUnit\": \"Count\",\n \"meteringValue\": 1108,\n \"resource\": \"Lambda\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702512000000,\n \"eventEndTime\": 1702598400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.06648,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1MWmEyJcNeyq2GQYRKdMNpmf\",\n \"price\": 0.00006\n },\n \"createDatetime\": 1707513923372,\n \"updateDatetime\": 1707516629568\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"ReadCapacityUnits\",\n \"meteringUnit\": \"ReadCapacityUnitHours\",\n \"meteringValue\": 230,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702425600000,\n \"eventEndTime\": 1702512000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 10.212,\n \"meteringQuantity\": 10,\n \"priceId\": \"price_1O5Im0JcNeyq2GQYxUNbagfv\",\n \"price\": 0.0444\n },\n \"createDatetime\": 1707513915790,\n \"updateDatetime\": 1707516602037\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"ReadCapacityUnits\",\n \"meteringUnit\": \"ReadCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702512000000,\n \"eventEndTime\": 1702598400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 10.656,\n \"meteringQuantity\": 10,\n \"priceId\": \"price_1O5Im0JcNeyq2GQYxUNbagfv\",\n \"price\": 0.0444\n },\n \"createDatetime\": 1707513915789,\n \"updateDatetime\": 1707516598066\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"ReadCapacityUnits\",\n \"meteringUnit\": \"ReadCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702598400000,\n \"eventEndTime\": 1702684800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 10.656,\n \"meteringQuantity\": 10,\n \"priceId\": \"price_1O5Im0JcNeyq2GQYxUNbagfv\",\n \"price\": 0.0444\n },\n \"createDatetime\": 1707513915790,\n \"updateDatetime\": 1707516602627\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"ReadCapacityUnits\",\n \"meteringUnit\": \"ReadCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702684800000,\n \"eventEndTime\": 1702771200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 10.656,\n \"meteringQuantity\": 10,\n \"priceId\": \"price_1O5Im0JcNeyq2GQYxUNbagfv\",\n \"price\": 0.0444\n },\n \"createDatetime\": 1707513915790,\n \"updateDatetime\": 1707516601465\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"ReadCapacityUnits\",\n \"meteringUnit\": \"ReadCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702771200000,\n \"eventEndTime\": 1702857600000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 10.656,\n \"meteringQuantity\": 10,\n \"priceId\": \"price_1O5Im0JcNeyq2GQYxUNbagfv\",\n \"price\": 0.0444\n },\n \"createDatetime\": 1707513915789,\n \"updateDatetime\": 1707516593882\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"ReadCapacityUnits\",\n \"meteringUnit\": \"ReadCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702857600000,\n \"eventEndTime\": 1702944000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 10.656,\n \"meteringQuantity\": 10,\n \"priceId\": \"price_1O5Im0JcNeyq2GQYxUNbagfv\",\n \"price\": 0.0444\n },\n \"createDatetime\": 1707513915790,\n \"updateDatetime\": 1707516601856\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"ReadCapacityUnits\",\n \"meteringUnit\": \"ReadCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702944000000,\n \"eventEndTime\": 1703030400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 10.656,\n \"meteringQuantity\": 10,\n \"priceId\": \"price_1O5Im0JcNeyq2GQYxUNbagfv\",\n \"price\": 0.0444\n },\n \"createDatetime\": 1707513915789,\n \"updateDatetime\": 1707516597886\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"ReadCapacityUnits\",\n \"meteringUnit\": \"ReadCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703030400000,\n \"eventEndTime\": 1703116800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 10.656,\n \"meteringQuantity\": 10,\n \"priceId\": \"price_1O5Im0JcNeyq2GQYxUNbagfv\",\n \"price\": 0.0444\n },\n \"createDatetime\": 1707513915790,\n \"updateDatetime\": 1707516602428\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"ReadCapacityUnits\",\n \"meteringUnit\": \"ReadCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703116800000,\n \"eventEndTime\": 1703203200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 10.656,\n \"meteringQuantity\": 10,\n \"priceId\": \"price_1O5Im0JcNeyq2GQYxUNbagfv\",\n \"price\": 0.0444\n },\n \"createDatetime\": 1707513915790,\n \"updateDatetime\": 1707516601272\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"ReadCapacityUnits\",\n \"meteringUnit\": \"ReadCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703203200000,\n \"eventEndTime\": 1703289600000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 10.656,\n \"meteringQuantity\": 10,\n \"priceId\": \"price_1O5Im0JcNeyq2GQYxUNbagfv\",\n \"price\": 0.0444\n },\n \"createDatetime\": 1707513915790,\n \"updateDatetime\": 1707516611075\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"ReadCapacityUnits\",\n \"meteringUnit\": \"ReadCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703289600000,\n \"eventEndTime\": 1703376000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 10.656,\n \"meteringQuantity\": 10,\n \"priceId\": \"price_1O5Im0JcNeyq2GQYxUNbagfv\",\n \"price\": 0.0444\n },\n \"createDatetime\": 1707513915790,\n \"updateDatetime\": 1707516601655\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"ReadCapacityUnits\",\n \"meteringUnit\": \"ReadCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703376000000,\n \"eventEndTime\": 1703462400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 10.656,\n \"meteringQuantity\": 10,\n \"priceId\": \"price_1O5Im0JcNeyq2GQYxUNbagfv\",\n \"price\": 0.0444\n },\n \"createDatetime\": 1707513915789,\n \"updateDatetime\": 1707516597701\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"ReadCapacityUnits\",\n \"meteringUnit\": \"ReadCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703462400000,\n \"eventEndTime\": 1703548800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 10.656,\n \"meteringQuantity\": 10,\n \"priceId\": \"price_1O5Im0JcNeyq2GQYxUNbagfv\",\n \"price\": 0.0444\n },\n \"createDatetime\": 1707513915790,\n \"updateDatetime\": 1707516602234\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"ReadCapacityUnits\",\n \"meteringUnit\": \"ReadCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703548800000,\n \"eventEndTime\": 1703635200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 10.656,\n \"meteringQuantity\": 10,\n \"priceId\": \"price_1O5Im0JcNeyq2GQYxUNbagfv\",\n \"price\": 0.0444\n },\n \"createDatetime\": 1707513915790,\n \"updateDatetime\": 1707516598301\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.694e-7,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702425600000,\n \"eventEndTime\": 1702512000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000014483699999999999561849178223316841895,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlzJcNeyq2GQYxEj3hWbE\",\n \"price\": 85.5\n },\n \"createDatetime\": 1707513915788,\n \"updateDatetime\": 1707516586067\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.749e-7,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702512000000,\n \"eventEndTime\": 1702598400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.00001495395000000000094373249449539176048,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlzJcNeyq2GQYxEj3hWbE\",\n \"price\": 85.5\n },\n \"createDatetime\": 1707513915789,\n \"updateDatetime\": 1707516593609\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.748e-7,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702598400000,\n \"eventEndTime\": 1702684800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000014945400000000000301380209850876656929,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlzJcNeyq2GQYxEj3hWbE\",\n \"price\": 85.5\n },\n \"createDatetime\": 1707513915789,\n \"updateDatetime\": 1707516586200\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.677e-7,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702684800000,\n \"eventEndTime\": 1702771200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000014338349999999999957691118991978673768,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlzJcNeyq2GQYxEj3hWbE\",\n \"price\": 85.5\n },\n \"createDatetime\": 1707513915788,\n \"updateDatetime\": 1707516578253\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.75e-7,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702771200000,\n \"eventEndTime\": 1702857600000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000014962499999999999322918623194823145583,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlzJcNeyq2GQYxEj3hWbE\",\n \"price\": 85.5\n },\n \"createDatetime\": 1707513915789,\n \"updateDatetime\": 1707516586173\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.749e-7,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702857600000,\n \"eventEndTime\": 1702944000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.00001495395000000000094373249449539176048,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlzJcNeyq2GQYxEj3hWbE\",\n \"price\": 85.5\n },\n \"createDatetime\": 1707513915788,\n \"updateDatetime\": 1707516586119\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.676e-7,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702944000000,\n \"eventEndTime\": 1703030400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000014329799999999999315338834347463570217,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlzJcNeyq2GQYxEj3hWbE\",\n \"price\": 85.5\n },\n \"createDatetime\": 1707513915789,\n \"updateDatetime\": 1707516593557\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.749e-7,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703030400000,\n \"eventEndTime\": 1703116800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.00001495395000000000094373249449539176048,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlzJcNeyq2GQYxEj3hWbE\",\n \"price\": 85.5\n },\n \"createDatetime\": 1707513915788,\n \"updateDatetime\": 1707516586096\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.749e-7,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703116800000,\n \"eventEndTime\": 1703203200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.00001495395000000000094373249449539176048,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlzJcNeyq2GQYxEj3hWbE\",\n \"price\": 85.5\n },\n \"createDatetime\": 1707513915788,\n \"updateDatetime\": 1707516578308\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.749e-7,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703203200000,\n \"eventEndTime\": 1703289600000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.00001495395000000000094373249449539176048,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlzJcNeyq2GQYxEj3hWbE\",\n \"price\": 85.5\n },\n \"createDatetime\": 1707513915788,\n \"updateDatetime\": 1707516586147\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.749e-7,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703289600000,\n \"eventEndTime\": 1703376000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.00001495395000000000094373249449539176048,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlzJcNeyq2GQYxEj3hWbE\",\n \"price\": 85.5\n },\n \"createDatetime\": 1707513915788,\n \"updateDatetime\": 1707516578281\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.75e-7,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703376000000,\n \"eventEndTime\": 1703462400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000014962499999999999322918623194823145583,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlzJcNeyq2GQYxEj3hWbE\",\n \"price\": 85.5\n },\n \"createDatetime\": 1707513915789,\n \"updateDatetime\": 1707516593668\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.749e-7,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703462400000,\n \"eventEndTime\": 1703548800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.00001495395000000000094373249449539176048,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlzJcNeyq2GQYxEj3hWbE\",\n \"price\": 85.5\n },\n \"createDatetime\": 1707513915788,\n \"updateDatetime\": 1707516586040\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"TimedStorage\",\n \"meteringUnit\": \"GBMonth\",\n \"meteringValue\": 1.75e-7,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703548800000,\n \"eventEndTime\": 1703635200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 0.000014962499999999999322918623194823145583,\n \"meteringQuantity\": 0,\n \"priceId\": \"price_1O5IlzJcNeyq2GQYxEj3hWbE\",\n \"price\": 85.5\n },\n \"createDatetime\": 1707513915789,\n \"updateDatetime\": 1707516593639\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"WriteCapacityUnits\",\n \"meteringUnit\": \"WriteCapacityUnitHours\",\n \"meteringValue\": 230,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702425600000,\n \"eventEndTime\": 1702512000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 51.06,\n \"meteringQuantity\": 51,\n \"priceId\": \"price_1O5Im3JcNeyq2GQYZQS7jTRy\",\n \"price\": 0.222\n },\n \"createDatetime\": 1707513915791,\n \"updateDatetime\": 1707516618837\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"WriteCapacityUnits\",\n \"meteringUnit\": \"WriteCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702512000000,\n \"eventEndTime\": 1702598400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 53.28,\n \"meteringQuantity\": 53,\n \"priceId\": \"price_1O5Im3JcNeyq2GQYZQS7jTRy\",\n \"price\": 0.222\n },\n \"createDatetime\": 1707513915791,\n \"updateDatetime\": 1707516611703\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"WriteCapacityUnits\",\n \"meteringUnit\": \"WriteCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702598400000,\n \"eventEndTime\": 1702684800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 53.28,\n \"meteringQuantity\": 53,\n \"priceId\": \"price_1O5Im3JcNeyq2GQYZQS7jTRy\",\n \"price\": 0.222\n },\n \"createDatetime\": 1707513915791,\n \"updateDatetime\": 1707516618061\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"WriteCapacityUnits\",\n \"meteringUnit\": \"WriteCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702684800000,\n \"eventEndTime\": 1702771200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 53.28,\n \"meteringQuantity\": 53,\n \"priceId\": \"price_1O5Im3JcNeyq2GQYZQS7jTRy\",\n \"price\": 0.222\n },\n \"createDatetime\": 1707513915792,\n \"updateDatetime\": 1707516629120\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"WriteCapacityUnits\",\n \"meteringUnit\": \"WriteCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702771200000,\n \"eventEndTime\": 1702857600000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 53.28,\n \"meteringQuantity\": 53,\n \"priceId\": \"price_1O5Im3JcNeyq2GQYZQS7jTRy\",\n \"price\": 0.222\n },\n \"createDatetime\": 1707513915791,\n \"updateDatetime\": 1707516618455\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"WriteCapacityUnits\",\n \"meteringUnit\": \"WriteCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702857600000,\n \"eventEndTime\": 1702944000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 53.28,\n \"meteringQuantity\": 53,\n \"priceId\": \"price_1O5Im3JcNeyq2GQYZQS7jTRy\",\n \"price\": 0.222\n },\n \"createDatetime\": 1707513915791,\n \"updateDatetime\": 1707516618654\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"WriteCapacityUnits\",\n \"meteringUnit\": \"WriteCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1702944000000,\n \"eventEndTime\": 1703030400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 53.28,\n \"meteringQuantity\": 53,\n \"priceId\": \"price_1O5Im3JcNeyq2GQYZQS7jTRy\",\n \"price\": 0.222\n },\n \"createDatetime\": 1707513915791,\n \"updateDatetime\": 1707516611496\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"WriteCapacityUnits\",\n \"meteringUnit\": \"WriteCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703030400000,\n \"eventEndTime\": 1703116800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 53.28,\n \"meteringQuantity\": 53,\n \"priceId\": \"price_1O5Im3JcNeyq2GQYZQS7jTRy\",\n \"price\": 0.222\n },\n \"createDatetime\": 1707513915791,\n \"updateDatetime\": 1707516619198\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"WriteCapacityUnits\",\n \"meteringUnit\": \"WriteCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703116800000,\n \"eventEndTime\": 1703203200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 53.28,\n \"meteringQuantity\": 53,\n \"priceId\": \"price_1O5Im3JcNeyq2GQYZQS7jTRy\",\n \"price\": 0.222\n },\n \"createDatetime\": 1707513915792,\n \"updateDatetime\": 1707516619382\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"WriteCapacityUnits\",\n \"meteringUnit\": \"WriteCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703203200000,\n \"eventEndTime\": 1703289600000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 53.28,\n \"meteringQuantity\": 53,\n \"priceId\": \"price_1O5Im3JcNeyq2GQYZQS7jTRy\",\n \"price\": 0.222\n },\n \"createDatetime\": 1707513915791,\n \"updateDatetime\": 1707516618260\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"WriteCapacityUnits\",\n \"meteringUnit\": \"WriteCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703289600000,\n \"eventEndTime\": 1703376000000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 53.28,\n \"meteringQuantity\": 53,\n \"priceId\": \"price_1O5Im3JcNeyq2GQYZQS7jTRy\",\n \"price\": 0.222\n },\n \"createDatetime\": 1707513915792,\n \"updateDatetime\": 1707516629303\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"WriteCapacityUnits\",\n \"meteringUnit\": \"WriteCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703376000000,\n \"eventEndTime\": 1703462400000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 53.28,\n \"meteringQuantity\": 53,\n \"priceId\": \"price_1O5Im3JcNeyq2GQYZQS7jTRy\",\n \"price\": 0.222\n },\n \"createDatetime\": 1707513915791,\n \"updateDatetime\": 1707516611294\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"WriteCapacityUnits\",\n \"meteringUnit\": \"WriteCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703462400000,\n \"eventEndTime\": 1703548800000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 53.28,\n \"meteringQuantity\": 53,\n \"priceId\": \"price_1O5Im3JcNeyq2GQYZQS7jTRy\",\n \"price\": 0.222\n },\n \"createDatetime\": 1707513915791,\n \"updateDatetime\": 1707516619026\n },\n {\n \"tenantId\": \"d5feaf90-71a9-41ee-b1b9-35e4242c3155\",\n \"userId\": \"accb3567-2b6e-41ae-b00d-6ce1f9a58d94\",\n \"datasetName\": \"CommonCrawlKinesisReadSagemakerComputeAndSQSWritePython20\",\n \"datasetId\": \"8e04743d71815b7867a915c5da514db6\",\n \"internalComponent\": \"TaskStorage\",\n \"meteringDimension\": \"WriteCapacityUnits\",\n \"meteringUnit\": \"WriteCapacityUnitHours\",\n \"meteringValue\": 240,\n \"resource\": \"DynamoDB\",\n \"resourceType\": \"DatasetInternalComponents\",\n \"eventStartTime\": 1703548800000,\n \"eventEndTime\": 1703635200000,\n \"billedStatus\": \"INTERNAL_ERROR\",\n \"billingDetails\": {\n \"billedUnits\": 53.28,\n \"meteringQuantity\": 53,\n \"priceId\": \"price_1O5Im3JcNeyq2GQYZQS7jTRy\",\n \"price\": 0.222\n },\n \"createDatetime\": 1707513915791,\n \"updateDatetime\": 1707516611883\n }\n ]\n}"}],"_postman_id":"97405692-5117-4b01-9aea-f19e7c03d0f9"}],"id":"243f3ba3-80fd-4dea-8827-4eca4f405f23","description":"

The list sub resource for the usagerecords is used to list a dataset's usage records.

\n","_postman_id":"243f3ba3-80fd-4dea-8827-4eca4f405f23"}],"id":"bd9093ef-4eca-47f3-a68e-663b08747df3","description":"

Datasets execution causes #Let's Data to initialize a variety of different AWS resources - these include the write connector (e.g. kinesis stream), the error connectors (e.g. S3 bucket) and different internal components such as queues, database tables, compute resources. We meter the usage of these resources for each dataset and create usage records. These usage records are then used in determining costs. The usagerecords has api for listing usage records.

\n","_postman_id":"bd9093ef-4eca-47f3-a68e-663b08747df3"},{"name":"costs","item":[{"name":"List Costs","id":"1b3f5396-0505-46ac-999e-b7a13091c586","protocolProfileBehavior":{"disableBodyPruning":true},"request":{"method":"GET","header":[{"key":"Authorization","value":"Bearer IdToken","description":"

The IdToken in \"Bearer IdToken\" format

\n","type":"text"},{"key":"LetsDataAuthorization","value":"Bearer AccessToken","description":"

The AccessToken in \"Bearer AccessToken\" format

\n","type":"text"}],"url":"https://www.letsdata.io/api/costs?tenantId=tenantId&userId=userId","description":"

costs GET

Use the costs GET api to list the billing account information, the payment method on file, a list of invoices, their payment status and links to pay the invoice /download the invoices as a PDF file.

Input Parameters:

tenantId: The tenantId of the logged in user. (TODO - this can be optional, API gets it from token)
userId: The userId of the user that owns the dataset. In case a TenantAdmin user wants to run the command on datasets created by other users in the organization, they can do so by specifying the userId of the dataset's owner. For example, &userId=078260ed-3124-4de0-8eee-cc5b5025e7ad
limit: [Optional] The limit for the number of results that are to be returned by the command. This is used in conjunction with pagination when large number of records are being retrieved. This is optional and the system does set some meaningful defaults in most APIs. Also, this limit is a hint for the API and the results are not guaranteed to be exactly the same number as the limit. The user needs to handle the following cases when specifying limits:
- The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved.
- The records may be a little more than the limit (~<10 or so). User should handle these gracefully.
  Rule of thumb in using limits is to treat it as a soft max limit. For example, &limit=100
\n
next: [Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved. For example, &next=dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw+4MpoRCd/2eL3WaI2IHe3/bLYH//gAYXtGXI01BZ5d5NwdWcVf7o5HGGpbvKibkd0zDfUUiJjI/aJQaSb2tM5mwflwszzdHuyNolNNtXwij1TjyGqLny2p0O5PquoYig8iq8YI=

Output Parameters:

The output is a JSON map that has the following sections:

    {\n        \"customer\": {\n            ...\n        },\n        \"paymentDetails\": {\n            ...\n        },\n        \"pricing\": [\n            {\n                ...\n            },\n            ...\n        ],\n        \"invoices\": [\n            {\n                ...\n            },\n            ...\n        ],\n        \"next\": \"String\"\n    }\n\n

customer: This is the billing account on file with the external billing system (Stripe) for the logged in user's tenant. This account is created using the credit card that was used at the company's registration. Since a company (tenant) can have many users, every user's activity is mapped back to this billing account for costing. Here is the schema for the customer json:

      \"customer\": {\n          \"customerName\": \"String\",\n          \"address\": {\n              \"city\": \"String\",\n              \"country\": \"String\",\n              \"line1\": \"String\",\n              \"line2\": \"String\",\n              \"postal_code\": \"String\",\n              \"state\": \"String\"\n          },\n          \"emailAddress\": \"String\",\n          \"phone\": \"String\"\n      },\n\n

paymentDetails: These are the payment details (CC details) that will be used to charge the customer. These are the CC details that were used at the time of registration. Here is the schema for the paymentDetails json:

      \"paymentDetails\": {\n          \"paymentMethodType\": \"String\",\n          \"ccLastFour\": \"String\",\n          \"ccDescription\": \"String\",\n          \"ccExpiry\": \"String\",\n          \"ccBrand\": \"String\"\n      },\n\n

pricing: Pricing is the list of different cost items that the customer is subscribed for. These cost items are the same as the metrics that are used in the dataset's usagerecords with the addition of a price element to these metrics. For example, Lambda execution time, Kinesis StorageShardHour etc. Each line item in the invoice will correspond to an item in this pricing list and the costs calculated for each line item would be based on the price defined in the pricing list elements. Here is the schema for the pricing json:
\n
```
      \"pricing\": [\n          {\n              \"productName\": \"String\",\n              \"productDescription\": \"String\",\n              \"productDefaultPrice\": \"Float\",\n              \"priceNickName\": \"String\",\n              \"priceUnitAmount\": \"Float\",\n          },\n          ...\n      ],\n\n
```
\n

invoices: These are the invoices (finalized bills) that were generated for each billing cycle. The invoices contain the start and end times for the billing duration, the amounts due broken down by tax and usage, the charge (if any) on the customer's CC, the payment Url to pay the invoice and a downloadable PDF link. It also contains an invoice line items list, which breaks down the invoice amount by the different pricing elements. Here is the schema for the invoices json:

  \"invoices\": [\n      {\n          \"tax\": 8.03,\n          \"total\": 87.51,\n          \"amountDue\": 87.55,\n          \"amountPaid\": 87.55,\n          \"charge\": \"ch_3MAySYJcNeyq2GQY10i2sWuo\",\n          \"currency\": \"usd\",\n          \"description\": null,\n          \"dueDate\": null,\n          \"startTime\": 1669994342,\n          \"endTime\": 1670080742,\n          \"paymentUrl\": \"https://invoice.stripe.com/i/acct_1HEibBJcNeyq2GQY/test_YWNjdF8xSEVpYkJKY05leXEyR1FZLF9NdW41ZjhiTG9Zem1ZcXNYeHkyS2lXVVdITE5FQ2JjLDY0MTg3NzYy0200055ed3LG?s=ap\",\n          \"pdf\": \"https://pay.stripe.com/invoice/acct_1HEibBJcNeyq2GQY/test_YWNjdF8xSEVpYkJKY05leXEyR1FZLF9NdW41ZjhiTG9Zem1ZcXNYeHkyS2lXVVdITE5FQ2JjLDY0MTg3NzYy0200055ed3LG/pdf?s=ap\",\n          \"status\": \"paid\",\n          \"invoiceLineItems\": [\n              {\n                  \"amount\": 79.48,\n                  \"amountExcludingTax\": 79.48,\n                  \"currency\": \"usd\",\n                  \"description\": \"23842898 \\u00d7 Compute - LambdaTaskExecutionDuration (at $0.00000333334 / day)\",\n                  \"endTime\": 1670080479,\n                  \"priceName\": \"LambdaTaskExecutionDuration\",\n                  \"startTime\": 1669994066,\n                  \"taxAmounts\": [\n                      {\n                          \"amount\": 8.03,\n                          \"taxRate\": \"txr_1Lr5icJcNeyq2GQYnLjk7yuU\"\n                      }\n                  ],\n                  \"unitPrice\": \"0.00000333334\",\n                  \"unitQuantity\": 238428.98\n              },\n              {\n                  \"amount\": 0.0,\n                  \"amountExcludingTax\": 0.0,\n                  \"currency\": \"usd\",\n                  \"description\": \"0 \\u00d7 KinesisWriteConnector - StorageShardHours (at $0.0003 / day)\",\n                  \"endTime\": 1670080479,\n                  \"priceName\": \"KinesisShardHours\",\n                  \"startTime\": 1669994066,\n                  \"taxAmounts\": [\n                      {\n                          \"amount\": 0.0,\n                          \"taxRate\": \"txr_1Lr5icJcNeyq2GQYnLjk7yuU\"\n                      }\n                  ],\n                  \"unitPrice\": \"0.0003\",\n                  \"unitQuantity\": 0.0\n              },\n              {\n                  \"amount\": 0.0,\n                  \"amountExcludingTax\": 0.0,\n                  \"currency\": \"usd\",\n                  \"description\": \"0 \\u00d7 KinesisWriteConnector - WriteCapacityUnits (at $0.00000000028 / day)\",\n                  \"endTime\": 1670080479,\n                  \"priceName\": \"KinesisWriteCapacityUnits\",\n                  \"startTime\": 1669994066,\n                  \"taxAmounts\": [\n                      {\n                          \"amount\": 0.0,\n                          \"taxRate\": \"txr_1Lr5icJcNeyq2GQYnLjk7yuU\"\n                      }\n                  ],\n                  \"unitPrice\": \"2.8E-10\",\n                  \"unitQuantity\": 0.0\n              },\n              {\n                  \"amount\": 0.0,\n                  \"amountExcludingTax\": 0.0,\n                  \"currency\": \"usd\",\n                  \"description\": \"0 \\u00d7 KinesisWriteConnector - ReadCapacityUnits (at $0.00000000028 / day)\",\n                  \"endTime\": 1670080479,\n                  \"priceName\": \"KinesisReadCapacityUnits\",\n                  \"startTime\": 1669994066,\n                  \"taxAmounts\": [\n                      {\n                          \"amount\": 0.0,\n                          \"taxRate\": \"txr_1Lr5icJcNeyq2GQYnLjk7yuU\"\n                      }\n                  ],\n                  \"unitPrice\": \"2.8E-10\",\n                  \"unitQuantity\": 0.0\n              },\n              {\n                  \"amount\": 0.0,\n                  \"amountExcludingTax\": 0.0,\n                  \"currency\": \"usd\",\n                  \"description\": \"0 \\u00d7 S3ErrorConnector - TagStorageHours (at $0.000000021 / day)\",\n                  \"endTime\": 1670080479,\n                  \"priceName\": \"S3ErrorConnectorTagStorageHours\",\n                  \"startTime\": 1669994066,\n                  \"taxAmounts\": [\n                      {\n                          \"amount\": 0.0,\n                          \"taxRate\": \"txr_1Lr5icJcNeyq2GQYnLjk7yuU\"\n                      }\n                  ],\n                  \"unitPrice\": \"2.1E-8\",\n                  \"unitQuantity\": 0.0\n              },\n              {\n                  \"amount\": 0.0,\n                  \"amountExcludingTax\": 0.0,\n                  \"currency\": \"usd\",\n                  \"description\": \"0 \\u00d7 S3ErrorConnector - StorageHours (at $0.000000021 / day)\",\n                  \"endTime\": 1670080479,\n                  \"priceName\": \"S3ErrorConnectorStorageHours\",\n                  \"startTime\": 1669994066,\n                  \"taxAmounts\": [\n                      {\n                          \"amount\": 0.0,\n                          \"taxRate\": \"txr_1Lr5icJcNeyq2GQYnLjk7yuU\"\n                      }\n                  ],\n                  \"unitPrice\": \"2.1E-8\",\n                  \"unitQuantity\": 0.0\n              }\n          ]\n      },\n      ...\n  ],\n\n

next: [Optional] The next token / pagination token to paginate the results. It is possible that the result list is empty but there is a next token. In this case user is expected to use the next token to retrieve the next page. Only when the next token is null, the result set is complete and there are no more results to be retrieved.
\n

Actual Example Output:

Here is an actual example output for the command:

    {\n        \"customer\": {\n            \"address\": {\n                \"city\": \"Redmond\",\n                \"country\": \"US\",\n                \"line1\": \"P.O.Box 3223\",\n                \"line2\": \"\",\n                \"postal_code\": \"98073\",\n                \"state\": \"WA\"\n            },\n            \"customerName\": \"#Let's Data Support Account\",\n            \"emailAddress\": \"support@letsdata.io\",\n            \"phone\": \"4578941275\"\n        },\n        \"paymentDetails\": [\n            {\n                \"ccBrand\": \"visa\",\n                \"ccDescription\": null,\n                \"ccExpiry\": \"10-2025\",\n                \"ccLastFour\": \"4242\",\n                \"paymentMethodType\": \"card\"\n            },\n            {\n                \"ccBrand\": \"visa\",\n                \"ccDescription\": null,\n                \"ccExpiry\": \"12-2024\",\n                \"ccLastFour\": \"4242\",\n                \"paymentMethodType\": \"card\"\n            }\n        ],\n        \"pricing\": [\n            {\n                \"priceNickName\": \"LambdaTaskExecutionDuration\",\n                \"priceUnitAmount\": \"0.000333334\",\n                \"productDefaultPrice\": null,\n                \"productDescription\": \"Let's Data's Lambda Compute product that measures the lambda tasks execution duration\",\n                \"productName\": \"Compute - LambdaTaskExecutionDuration\"\n            },\n            {\n                \"priceNickName\": \"KinesisShardHours\",\n                \"priceUnitAmount\": \"0.03\",\n                \"productDefaultPrice\": null,\n                \"productDescription\": \"Let's Data's Kinesis Write Connector's Storage product that measures the Kinesis stream's Shard Hours\",\n                \"productName\": \"KinesisWriteConnector - StorageShardHours\"\n            },\n            {\n                \"priceNickName\": \"KinesisWriteCapacityUnits\",\n                \"priceUnitAmount\": \"0.000000028\",\n                \"productDefaultPrice\": null,\n                \"productDescription\": \"Let's Data's Kinesis Write Connector product that measures the Kinesis stream's write capacity units usage.\",\n                \"productName\": \"KinesisWriteConnector - WriteCapacityUnits\"\n            },\n            {\n                \"priceNickName\": \"KinesisReadCapacityUnits\",\n                \"priceUnitAmount\": \"0.000000028\",\n                \"productDefaultPrice\": null,\n                \"productDescription\": \"Let's Data's Kinesis Write Connector product that measures the Kinesis stream's read capacity units usage.\",\n                \"productName\": \"KinesisWriteConnector - ReadCapacityUnits\"\n            },\n            {\n                \"priceNickName\": \"S3ErrorConnectorTagStorageHours\",\n                \"priceUnitAmount\": \"0.0000021\",\n                \"productDefaultPrice\": null,\n                \"productDescription\": \"Let's Data's S3 Error Connector product that measures the S3 Bucket's tag storage hours usage.\",\n                \"productName\": \"S3ErrorConnector - TagStorageHours\"\n            },\n            {\n                \"priceNickName\": \"S3ErrorConnectorStorageHours\",\n                \"priceUnitAmount\": \"0.0000021\",\n                \"productDefaultPrice\": null,\n                \"productDescription\": \"Let's Data's S3 Error Connector product that measures the S3 Bucket's storage hours usage.\",\n                \"productName\": \"S3ErrorConnector - StorageHours\"\n            }\n        ],\n        \"invoices\": [\n            {\n                \"amountDue\": 0.0,\n                \"amountPaid\": 0.0,\n                \"charge\": null,\n                \"currency\": \"usd\",\n                \"description\": null,\n                \"dueDate\": null,\n                \"endTime\": 1673623142,\n                \"invoiceLineItems\": [\n                    {\n                        \"amount\": 0.0,\n                        \"amountExcludingTax\": 0.0,\n                        \"currency\": \"usd\",\n                        \"description\": \"0 \\u00d7 Compute - LambdaTaskExecutionDuration (at $0.00000333334 / day)\",\n                        \"endTime\": 1673623142,\n                        \"priceName\": \"LambdaTaskExecutionDuration\",\n                        \"startTime\": 1673536742,\n                        \"taxAmounts\": [\n                            {\n                                \"amount\": 0.0,\n                                \"taxRate\": \"txr_1Lr5icJcNeyq2GQYnLjk7yuU\"\n                            }\n                        ],\n                        \"unitPrice\": \"0.00000333334\",\n                        \"unitQuantity\": 0.0\n                    },\n                    {\n                        \"amount\": 0.0,\n                        \"amountExcludingTax\": 0.0,\n                        \"currency\": \"usd\",\n                        \"description\": \"0 \\u00d7 KinesisWriteConnector - StorageShardHours (at $0.0003 / day)\",\n                        \"endTime\": 1673623142,\n                        \"priceName\": \"KinesisShardHours\",\n                        \"startTime\": 1673536742,\n                        \"taxAmounts\": [\n                            {\n                                \"amount\": 0.0,\n                                \"taxRate\": \"txr_1Lr5icJcNeyq2GQYnLjk7yuU\"\n                            }\n                        ],\n                        \"unitPrice\": \"0.0003\",\n                        \"unitQuantity\": 0.0\n                    },\n                    {\n                        \"amount\": 0.0,\n                        \"amountExcludingTax\": 0.0,\n                        \"currency\": \"usd\",\n                        \"description\": \"0 \\u00d7 KinesisWriteConnector - WriteCapacityUnits (at $0.00000000028 / day)\",\n                        \"endTime\": 1673623142,\n                        \"priceName\": \"KinesisWriteCapacityUnits\",\n                        \"startTime\": 1673536742,\n                        \"taxAmounts\": [\n                            {\n                                \"amount\": 0.0,\n                                \"taxRate\": \"txr_1Lr5icJcNeyq2GQYnLjk7yuU\"\n                            }\n                        ],\n                        \"unitPrice\": \"2.8E-10\",\n                        \"unitQuantity\": 0.0\n                    },\n                    {\n                        \"amount\": 0.0,\n                        \"amountExcludingTax\": 0.0,\n                        \"currency\": \"usd\",\n                        \"description\": \"0 \\u00d7 KinesisWriteConnector - ReadCapacityUnits (at $0.00000000028 / day)\",\n                        \"endTime\": 1673623142,\n                        \"priceName\": \"KinesisReadCapacityUnits\",\n                        \"startTime\": 1673536742,\n                        \"taxAmounts\": [\n                            {\n                                \"amount\": 0.0,\n                                \"taxRate\": \"txr_1Lr5icJcNeyq2GQYnLjk7yuU\"\n                            }\n                        ],\n                        \"unitPrice\": \"2.8E-10\",\n                        \"unitQuantity\": 0.0\n                    },\n                    {\n                        \"amount\": 0.0,\n                        \"amountExcludingTax\": 0.0,\n                        \"currency\": \"usd\",\n                        \"description\": \"0 \\u00d7 S3ErrorConnector - TagStorageHours (at $0.000000021 / day)\",\n                        \"endTime\": 1673623142,\n                        \"priceName\": \"S3ErrorConnectorTagStorageHours\",\n                        \"startTime\": 1673536742,\n                        \"taxAmounts\": [\n                            {\n                                \"amount\": 0.0,\n                                \"taxRate\": \"txr_1Lr5icJcNeyq2GQYnLjk7yuU\"\n                            }\n                        ],\n                        \"unitPrice\": \"2.1E-8\",\n                        \"unitQuantity\": 0.0\n                    },\n                    {\n                        \"amount\": 0.0,\n                        \"amountExcludingTax\": 0.0,\n                        \"currency\": \"usd\",\n                        \"description\": \"0 \\u00d7 S3ErrorConnector - StorageHours (at $0.000000021 / day)\",\n                        \"endTime\": 1673623142,\n                        \"priceName\": \"S3ErrorConnectorStorageHours\",\n                        \"startTime\": 1673536742,\n                        \"taxAmounts\": [\n                            {\n                                \"amount\": 0.0,\n                                \"taxRate\": \"txr_1Lr5icJcNeyq2GQYnLjk7yuU\"\n                            }\n                        ],\n                        \"unitPrice\": \"2.1E-8\",\n                        \"unitQuantity\": 0.0\n                    }\n                ],\n                \"paymentUrl\": \"https://invoice.stripe.com/i/acct_1HEibBJcNeyq2GQY/test_YWNjdF8xSEVpYkJKY05leXEyR1FZLF9OQTlQa3pGaERGWDZldkhCcUZWZzVtM1hNdmdSUmhmLDY0MTg4MDYy0200hts7MYqA?s=ap\",\n                \"pdf\": \"https://pay.stripe.com/invoice/acct_1HEibBJcNeyq2GQY/test_YWNjdF8xSEVpYkJKY05leXEyR1FZLF9OQTlQa3pGaERGWDZldkhCcUZWZzVtM1hNdmdSUmhmLDY0MTg4MDYy0200hts7MYqA/pdf?s=ap\",\n                \"startTime\": 1673536742,\n                \"status\": \"paid\",\n                \"tax\": 0.0,\n                \"total\": 0.0\n            }\n        ],\n        \"next\": \"in_1MPp74JcNeyq2GQYBxYwfdjn\"\n    }\n\n

Here are the different HttpStatusCodes that are returned and their sub cases:

200:

Request successfully retrieved the usagerecords for the dataset. The response body has the tasks, taskLogs and a next token for pagination.

    {\n        \"customer\": {\n            ...\n        },\n        \"paymentDetails\": {\n            ...\n        },\n        \"pricing\": [\n            {\n                ...\n            },\n            ...\n        ],\n        \"invoices\": [\n            {\n                ...\n            },\n            ...\n        ],\n        \"next\": \"String\"\n    }\n\n

500:

An unexpected error has occurred.

            {\n            \"statusCode\": \"INTERNAL_SERVER_ERROR\",\n            \"message\": \"Internal Server Error, please try again later.\"\n            }\n\n

In unknown exception scenarios, the API could return a 500 with the error as a string in the response body (not JSON).
\n

Examples:

Example 1: list the costs for the company - GET www.letsdata.io/api/costs?tenantId=tenantId&userId=userId
Example 2: list the costs, limit the results to 100 invoices - GET www.letsdata.io/api/costs?tenantId=tenantId&userId=userId&limit=100
Example 3: list the costs, paginate using the pagination tokens - GET www.letsdata.io/api/costs?tenantId=tenantId&userId=userId&next=in_1MPp74JcNeyq2GQYBxYwfdjn

Docs:

You can also learn all about Costs at: https://www.letsdata.io/docs#billing

\n","urlObject":{"path":["api","costs"],"host":["https://www.letsdata.io"],"query":[{"description":{"content":"

The tenantId of the logged in user

\n","type":"text/plain"},"key":"tenantId","value":"tenantId"},{"description":{"content":"

\n","type":"text/plain"},"key":"userId","value":"userId"},{"disabled":true,"description":{"content":"

The results may be lesser in number than the limit (even empty) and the result has a pagination token. The user is expected to use the next token to retrieve the next page in results. This is because the data is retrieved from many different segments and different segments might not return the exact number of records to satisfy the limit, so the aggregate could be lesser than the limit. Only when the next token is null, the result set is complete and there are no more results to be retrieved.
The records may be a little more than the limit (~<10 or so). User should handle these gracefully.\n Rule of thumb in using limits is to treat it as a soft max limit. For example, &limit=100

\n","type":"text/plain"},"key":"limit","value":"100"},{"disabled":true,"description":{"content":"

\n","type":"text/plain"},"key":"next","value":"dlYPOlyw90m1tNkefMuVdlItAnmpTT1FyhyGw%2B4MpoRCd%2F2eL3WaI2IHe3%2FbLYH%2F%2FgAYXtGXI01BZ5d5NwdWcVf7o5HGGpbvKibkd0zDfUUiJjI%2FaJQaSb2tM5mwflwszzdHuyNolNNtXwij1TjyGqLny2p0O5PquoYig8iq8YI%3D"}],"variable":[]}},"response":[],"_postman_id":"1b3f5396-0505-46ac-999e-b7a13091c586"}],"id":"d2d214dd-f521-43e4-a001-89daf3db965b","description":"

The API's costs resource to list the billing account information, the payment method on file, the pricing details, a list of invoices, their payment status and links to pay the invoice /download the invoices as a PDF file.

\n","_postman_id":"d2d214dd-f521-43e4-a001-89daf3db965b"}],"event":[{"listen":"prerequest","script":{"id":"137c6e61-abfe-4dba-aabf-7b81a1e6b4de","type":"text/javascript","exec":[""]}},{"listen":"test","script":{"id":"c06a908f-8c9b-4fb0-b5ff-351d6c11bbb9","type":"text/javascript","exec":[""]}}],"variable":[{"key":"baseUrl","value":"https://www.letsdata.io"},{"key":"IdToken","value":"IdToken","type":"string"},{"key":"AccessToken","value":"AccessToken","type":"string"},{"key":"TenantId","value":"tenantId","type":"string"},{"key":"UserId","value":"userId","type":"string"}]}