NiFi - Lesson 13 - Reading and Writing to PostgreSQL Database

Опубликовано: 29 Сентябрь 2024
на канале: Vikas Jha

14,145

connect on Fiverr for job support: https://www.fiverr.com/automateanythin
.
. For meeting: https://calendly.com/learnwithvikasjh...
.
. for more free & premium courses: https://itpanther.com/
.
. Learn More Here: https://www.itpanther.com ubscribe to upport the channel: https://youtube.com/c/vikasjha001?sub...
Need help? Message me on LinkedIn:   / vikasjha001
Want to connect on Instagram? Here is my id @vikasjha001 Connect to me:
💥 LinkedIn
  / vikas-kumar-jha-739639121

📷 Instagram
  / vikasjha001

✈️ Channel
   / lifebeyondwork001

QueryDatabaseTable
Description:
Generates and executes a QL select query to fetch all rows whose values in the specified Maximum Value column(s) are larger than the previously-seen maxima. Query result will be converted to Avro format. Expression Language is supported for several properties, but no incoming connections are permitted. The Variable Registry may be used to provide values for any property containing Expression Language. If it is desired to leverage flow file attributes to perform these queries, the GenerateTableFetch and/or ExecuteQL processors can be used for this purpose. treaming is used so arbitrarily large result sets are supported. This processor can be scheduled to run on a timer or cron expression, using the standard scheduling methods. This processor is intended to be run on the Primary Node only. FlowFile attribute 'querydbtable.row.count' indicates how many rows were selected.

PutDatabaseRecord
Description:
The PutDatabaseRecord processor uses a specified RecordReader to input (possibly multiple) records from an incoming flow file. These records are translated to QL statements and executed as a single batch. If any errors occur, the flow file is routed to failure or retry, and if the records are transmitted successfully, the incoming flow file is routed to success. The type of statement executed by the processor is specified via the tatement Type property, which accepts some hard-coded values such as INERT, UPDATE, and DELETE, as well as 'Use statement.type Attribute', which causes the processor to get the statement type from a flow file attribute. IMPORTANT: If the tatement Type is UPDATE, then the incoming records must not alter the value(s) of the primary keys (or user-specified Update Keys). If such records are encountered, the UPDATE statement issued to the database may do nothing (if no existing records with the new primary key values are found), or could inadvertently corrupt the existing data (by changing records for which the new values of the primary keys exist). Buy my Udemy courses at a special price for a limited time:
✅ https://www.itpanther.com/prometheus-...
✅ https://www.itpanther.com/grafana
✅ https://www.itpanther.com/python
✅ https://www.itpanther.com/liferay
✅ https://www.itpanther.com/apachenifia...
✅ https://www.itpanther.com/apachenifi
✅ https://www.itpanther.com/redis

🤝 For collaboration or other inquiries connect
📧 Email: [email protected]
📞 Whatsapp: +917042103414