• Anna@lemmy.ml
    link
    fedilink
    arrow-up
    2
    ·
    3 days ago

    Check if a CSV exists and if it does rename to the filename_date.CSV and upload to hdfs

    • ☆ Yσɠƚԋσʂ ☆@lemmy.mlOP
      link
      fedilink
      arrow-up
      3
      ·
      3 days ago

      here’s what DeepSeek gave me for the following prompt: write a small bash script to check if a CSV exists and if it does rename to the filename_date.CSV and upload to hdfs, keep it simple

      #!/bin/bash
      
      # Check if filename argument is provided
      if [ $# -eq 0 ]; then
          echo "Usage: $0 <csv_filename>"
          exit 1
      fi
      
      CSV_FILE="$1"
      
      # Check if file exists
      if [ ! -f "$CSV_FILE" ]; then
          echo "Error: File $CSV_FILE not found!"
          exit 1
      fi
      
      # Generate new filename with date (YYYYMMDD format)
      DATE=$(date +%Y%m%d)
      NEW_FILENAME="${CSV_FILE%.*}_${DATE}.csv"
      
      # Rename the file
      mv "$CSV_FILE" "$NEW_FILENAME"
      
      # Upload to HDFS
      hdfs dfs -put "$NEW_FILENAME" /path/to/hdfs/directory/
      
      echo "Successfully processed: $NEW_FILENAME"
      
      • Anna@lemmy.ml
        link
        fedilink
        arrow-up
        3
        ·
        3 days ago

        OK at least it didn’t create functions for everything. ChatGPT had a function to kinit, to rename and to upload to hdfs. And each function had 2-3 line comments. I mean for a single command how can you put 3 lines of comments.