Skip to content

Commit e8e3435

Browse files
soerenmaucheradminniamccash
authored
Use last run datetime for data load (#88)
* Added Sprint Scan Script: "Use last run datetime for JDBC data loads" * Update README.md Update description for sprint scan script: Use last run datetime for JDBC data loads --------- Co-authored-by: admin <admin@example.com> Co-authored-by: niamccash <39105458+niamccash@users.noreply.github.com>
1 parent 3bd08fd commit e8e3435

File tree

3 files changed

+46
-1
lines changed

3 files changed

+46
-1
lines changed

‎README.md‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -267,6 +267,9 @@ Note: It was suggested by ServiceNow support to add table "http_connection" in c
267267
### Avoid using alert() in client scripts
268268
It is recommended to use an OOB library for modals in order to improve the user experience instead of alert().
269269

270+
### Use "last run datetime" for JDBC data loads
271+
In your JDBC data load configuration, ensure that the 'last run datetime' option is set to true and configure the target database field to serve as a timestamp, as this best practice enables incremental data loading and improves performance in data integration processes using JDBC.
272+
270273
# Additional resources
271274

272275
Please check these additional links for more information and details:

‎ca8467c41b9abc10ce0f62c3b24bcbaa/checksum.txt‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
EwzwYi9oGVvBPFVVP4VvTH8iqkJk6zG-ugt1IQoWzimJwfCK41JFgpYBAyaYT9WYBgBmwJnQIukNiq2zOdAxDHmJun9N0Mpe6Q9Lp0vaj_pCeUgq2-o_QQLrSsmGtE-v7jCix_Je-lRKCEXfm_qaFmVsuZ_cCorZXg_Jh3Y8MQyxzRe_FSPPYBoORzY15gkeKONfUpUHG1secSFdVx5guLGl8khrY9sxTVpJlby1TzM5jA9HbeTqjVst4cv8OrbSppCCjRT7fdORqksNN_f4AbOW5UlGFQC4NnWuhGbOb6Wh5Jbuf2mAc3889aXO__tXaxarYujlHR-JAYnvFEtJB_W3kyfy1E6l-wvjPFPi0HD3jEA0YaHXUlypJ-U0EPfIs_W6zWnypB5ODwQ3ntGOr8eBbbNuqySIrJNCsciq5n8gT31eL71q_MDX6boGnIoOxDpwuSX7qr1AeQdW1H4X-7m1oVbnyPhzDLgbCL2kkXcoVhhZ4YjQ8JkcXNf81FekS1P-jmpZZmFPmixFUrNHbGWt3M28LRdxmk1MM_av-Dc94sH7Ic6tmcZwNScfjbVhzCHH3wI6DH8ewsC2ZTYQ17BaT4pNwPNTiMBGHHszEYIWy41DIoe-tLfgPyf8woq5LrQrkqLck3EVrvP6EXX12x0iop0F9V1J2KIY0SuEKFk
1+
L05SDNFQIepqo45ck9oJnUfhlsshR11vQgHkD4wzOpQrjSZFe2NZzwMgkg2NK1YTICOOOv9il_jnQzongixvCmUzcYXEiReSfy6hsdaKsnOnwgxfVh_WDZUYObwLcQTIT7RzE-YnPpL46yHDJKAWzdbf2iSx50xMlOhS4AiJ2900eVr8YYQvs9sCQlY3LNyYaInmgwKuyYBjQ4RXsf-ZEylc4349-ksoBu0sekZLqZfHDoXcwInrlzJloTWPGfu35AE8BuLUYIiGM8ykvB4a9ODOrXDuqF4VqWFzhFSoCVvvfsXUGx4flSVfJmHSuTc2KKjuMZKy6CS62M506U8XPJbbJroJ57XvpgjpGhtH2eaODZj1GGMymQhbrrgwqTfaxusIANtx9ZaD4LkMh12IGwTi397o1Hcvjr34hnpU_jDPYFo0UOBpnoofdJE7y_UHjVZSsmqXow_TblntZ_wQ5UA0_qVkOpryeAl5mBR9aI4t-Y1jB7N-Lr7vdoal69U0DB0KUuvY5LQxPPQXC_IG_yrdz4pRTlKx9EgzGelNfUsl6d9QsMFfKBZ0mpS7HWUg_TRX_A8-UHCEYlEUr55dlfVKAZVtOqfw_H6kiVeHtxONNOTxoEioALWazwelFxc9IEnSkugs6W7fFYKwNV4neZRRgOe6SN2oAG_tkZUojUc

‎ca8467c41b9abc10ce0f62c3b24bcbaa/update/scan_table_check_f9f9659e977931106c7cfed11153afc7.xml‎

Lines changed: 42 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,42 @@
1+
<?xml version="1.0" encoding="UTF-8"?><record_update table="scan_table_check">
2+
<scan_table_check action="INSERT_OR_UPDATE">
3+
<active>true</active>
4+
<advanced>false</advanced>
5+
<category>performance</category>
6+
<conditions table="sys_data_source">type=JDBC^use_last_run_datetime=false^EQ<item display_value="JDBC" endquery="false" field="type" goto="false" newquery="false" operator="=" or="false" value="JDBC"/>
7+
<item endquery="false" field="use_last_run_datetime" goto="false" newquery="false" operator="=" or="false" value="false"/>
8+
<item endquery="true" field="" goto="false" newquery="false" operator="=" or="false" value=""/>
9+
</conditions>
10+
<description>Using "last run datetime" is a best practice in data integration processes using JDBC. It enables incremental data loading and improves performance.</description>
11+
<documentation_url/>
12+
<finding_type>scan_finding</finding_type>
13+
<name>Use last run datetime for JDBC data loads</name>
14+
<priority>4</priority>
15+
<resolution_details>In your JDBC data load configuration, ensure that the "last run datetime" option is set to true, and configure the target database field to serve as a timestamp.</resolution_details>
16+
<run_condition/>
17+
<score_max>100</score_max>
18+
<score_min>0</score_min>
19+
<score_scale>1</score_scale>
20+
<script><![CDATA[(function (engine) {
21+
22+
// Add your code here
23+
24+
})(engine);]]></script>
25+
<short_description>Use last run datetime for JDBC data loads</short_description>
26+
<sys_class_name>scan_table_check</sys_class_name>
27+
<sys_created_by>admin</sys_created_by>
28+
<sys_created_on>2023-10-12 15:37:21</sys_created_on>
29+
<sys_id>f9f9659e977931106c7cfed11153afc7</sys_id>
30+
<sys_mod_count>1</sys_mod_count>
31+
<sys_name>Use last run datetime for JDBC data loads</sys_name>
32+
<sys_package display_value="Example Instance Checks" source="x_appe_exa_checks">ca8467c41b9abc10ce0f62c3b24bcbaa</sys_package>
33+
<sys_policy/>
34+
<sys_scope display_value="Example Instance Checks">ca8467c41b9abc10ce0f62c3b24bcbaa</sys_scope>
35+
<sys_update_name>scan_table_check_f9f9659e977931106c7cfed11153afc7</sys_update_name>
36+
<sys_updated_by>admin</sys_updated_by>
37+
<sys_updated_on>2023-10-12 15:45:31</sys_updated_on>
38+
<table>sys_data_source</table>
39+
<use_manifest>false</use_manifest>
40+
</scan_table_check>
41+
<sys_translated_text action="delete_multiple" query="documentkey=f9f9659e977931106c7cfed11153afc7"/>
42+
</record_update>

0 commit comments

Comments
 (0)