fix syncronize using worker and add duration syncronize

fix:chatbot ui

.env.example

@@ -67,4 +67,5 @@ AWS_USE_PATH_STYLE_ENDPOINT=false
 VITE_APP_NAME="${APP_NAME}"
 
 API_KEY_GOOGLE="xxxxx"
-SPREAD_SHEET_ID="xxxxx"
+SPREAD_SHEET_ID="xxxxx"
+OPENAI_API_KEY="xxxxx"

README.md

@@ -1,66 +1,112 @@
-<p align="center"><a href="https://laravel.com" target="_blank"><img src="https://raw.githubusercontent.com/laravel/art/master/logo-lockup/5%20SVG/2%20CMYK/1%20Full%20Color/laravel-logolockup-cmyk-red.svg" width="400" alt="Laravel Logo"></a></p>
+# Usage icon
 
-<p align="center">
+search or pick icon in <a href="https://icon-sets.iconify.design/mingcute/?keyword=mingcute">here</a>
-<a href="https://github.com/laravel/framework/actions"><img src="https://github.com/laravel/framework/workflows/tests/badge.svg" alt="Build Status"></a>
-<a href="https://packagist.org/packages/laravel/framework"><img src="https://img.shields.io/packagist/dt/laravel/framework" alt="Total Downloads"></a>
-<a href="https://packagist.org/packages/laravel/framework"><img src="https://img.shields.io/packagist/v/laravel/framework" alt="Latest Stable Version"></a>
-<a href="https://packagist.org/packages/laravel/framework"><img src="https://img.shields.io/packagist/l/laravel/framework" alt="License"></a>
-</p>
 
-## About Laravel
+# Set up queue for running automatically
 
-Laravel is a web application framework with expressive, elegant syntax. We believe development must be an enjoyable and creative experience to be truly fulfilling. Laravel takes the pain out of development by easing common tasks used in many web projects, such as:
+-   Install Supervisor
 
-- [Simple, fast routing engine](https://laravel.com/docs/routing).
+```
-- [Powerful dependency injection container](https://laravel.com/docs/container).
+sudo apt update && sudo apt install supervisor -y
-- Multiple back-ends for [session](https://laravel.com/docs/session) and [cache](https://laravel.com/docs/cache) storage.
+```
-- Expressive, intuitive [database ORM](https://laravel.com/docs/eloquent).
-- Database agnostic [schema migrations](https://laravel.com/docs/migrations).
-- [Robust background job processing](https://laravel.com/docs/queues).
-- [Real-time event broadcasting](https://laravel.com/docs/broadcasting).
 
-Laravel is accessible, powerful, and provides tools required for large, robust applications.
+-   Create Supervisor Config
 
-## Learning Laravel
+```
+sudo nano /etc/supervisor/conf.d/laravel-worker.conf
 
-Laravel has the most extensive and thorough [documentation](https://laravel.com/docs) and video tutorial library of all modern web application frameworks, making it a breeze to get started with the framework.
+[program:laravel-worker]
+process_name=%(program_name)s_%(process_num)02d
+command=php /home/arifal/development/sibedas-pbg-web/artisan queue:work --queue=default --timeout=40000 --tries=1
+autostart=true
+autorestart=true
+numprocs=1
+redirect_stderr=true
+stdout_logfile=/home/arifal/development/sibedas-pbg-web/storage/logs/worker.log
+stopasgroup=true
+killasgroup=true
+```
 
-You may also try the [Laravel Bootcamp](https://bootcamp.laravel.com), where you will be guided through building a modern Laravel application from scratch.
+-   Reload Supervisor
 
-If you don't feel like reading, [Laracasts](https://laracasts.com) can help. Laracasts contains thousands of video tutorials on a range of topics including Laravel, modern PHP, unit testing, and JavaScript. Boost your skills by digging into our comprehensive video library.
+```
+sudo supervisorctl reread
+sudo supervisorctl update
+sudo supervisorctl start laravel-worker
+sudo supervisorctl restart laravel-worker
+sudo supervisorctl status
+```
 
-## Laravel Sponsors
+# How to running
 
-We would like to extend our thanks to the following sponsors for funding Laravel development. If you are interested in becoming a sponsor, please visit the [Laravel Partners program](https://partners.laravel.com).
+-   Install composer package
 
-### Premium Partners
+```
+composer install
+```
 
-- **[Vehikl](https://vehikl.com/)**
+-   Install npm package
-- **[Tighten Co.](https://tighten.co)**
-- **[WebReinvent](https://webreinvent.com/)**
-- **[Kirschbaum Development Group](https://kirschbaumdevelopment.com)**
-- **[64 Robots](https://64robots.com)**
-- **[Curotec](https://www.curotec.com/services/technologies/laravel/)**
-- **[Cyber-Duck](https://cyber-duck.co.uk)**
-- **[DevSquad](https://devsquad.com/hire-laravel-developers)**
-- **[Jump24](https://jump24.co.uk)**
-- **[Redberry](https://redberry.international/laravel/)**
-- **[Active Logic](https://activelogic.com)**
-- **[byte5](https://byte5.de)**
-- **[OP.GG](https://op.gg)**
 
-## Contributing
+```
+npm install && npm run build
+```
 
-Thank you for considering contributing to the Laravel framework! The contribution guide can be found in the [Laravel documentation](https://laravel.com/docs/contributions).
+-   Create symlinks storage
 
-## Code of Conduct
+```
+php artisan storage:link
+```
 
-In order to ensure that the Laravel community is welcoming to all, please review and abide by the [Code of Conduct](https://laravel.com/docs/contributions#code-of-conduct).
+-   Running migration
 
-## Security Vulnerabilities
+```
+php artisan migrate
+```
 
-If you discover a security vulnerability within Laravel, please send an e-mail to Taylor Otwell via [taylor@laravel.com](mailto:taylor@laravel.com). All security vulnerabilities will be promptly addressed.
+-   Running seeder
 
-## License
+```
+php artisan db:seed
+```
 
-The Laravel framework is open-sourced software licensed under the [MIT license](https://opensource.org/licenses/MIT).
+-   Create view table
+-   excute all sql queries on folder database/view_query
+
+# Add ENV variable
+
+-   API_KEY_GOOGLE
+
+```
+Get api key from google developer console for and turn on spreadsheet api or feaature for google sheet
+```
+
+-   SPREAD_SHEET_ID
+
+```
+Get spreadsheet id from google sheet link
+```
+
+-   OPENAI_API_KEY
+
+```
+Get OpenAI API key from chatgpt subscription
+```
+
+-   ENV
+
+```
+
+API_KEY_GOOGLE="xxxxx"
+SPREAD_SHEET_ID="xxxxx"
+OPENAI_API_KEY="xxxxx"
+
+```
+
+# Technology version
+
+-   php 8.3
+-   Laravel 11
+-   node v22.13.0
+-   npm 10.9.2
+-   mariadb Ver 15.1 Distrib 10.6.18-MariaDB, for debian-linux-gnu (x86_64) using EditLine wrapper
+-   Ubuntu 24.04

app/Console/Commands/ExecuteScraping.php

@@ -2,6 +2,7 @@
 
 namespace App\Console\Commands;
 
+use App\Jobs\SyncronizeSIMBG;
 use App\Services\ServiceSIMBG;
 use Illuminate\Console\Command;
 use \Illuminate\Support\Facades\Log;
@@ -28,13 +29,12 @@ class ExecuteScraping extends Command
 
     private $service_simbg;
 
-    public function __construct(ServiceSIMBG $service_simbg){
+    public function __construct(){
-        $this->service_simbg = $service_simbg;
         parent::__construct();
     }
     public function handle()
     {
+        SyncronizeSIMBG::dispatch()->onQueue('default');
         Log::info("running scheduler daily scraping");
-        $this->service_simbg->syncTaskList();
     }
 }

app/Console/Commands/ScrapingData.php

@@ -0,0 +1,95 @@
+<?php
+
+namespace App\Console\Commands;
+
+use App\Jobs\ScrapingDataJob;
+use App\Models\ImportDatasource;
+use App\Services\ServiceGoogleSheet;
+use App\Services\ServicePbgTask;
+use App\Services\ServiceTabPbgTask;
+use App\Services\ServiceTokenSIMBG;
+use GuzzleHttp\Client; // Import Guzzle Client
+use Illuminate\Console\Command;
+use Illuminate\Support\Facades\Log;
+use Illuminate\Support\Facades\DB;
+
+class ScrapingData extends Command
+{
+    /**
+     * The name and signature of the console command.
+     *
+     * @var string
+     */
+    protected $signature = 'app:scraping-data';
+
+    /**
+     * The console command description.
+     *
+     * @var string
+     */
+    protected $description = 'Command description';
+    /**
+     * Inject dependencies.
+     */
+    public function __construct(
+    ) {
+        parent::__construct();
+    }
+
+    public function handle()
+    {
+        dispatch(new ScrapingDataJob());
+
+        $this->info("Scraping job dispatched successfully");
+    }
+
+    /**
+     * Execute the console command.
+     */
+    // public function handle()
+    // {
+
+    //     try {
+    //         // Create a record with "processing" status
+    //         $import_datasource = ImportDatasource::create([
+    //             'message' => 'Initiating scraping...',
+    //             'response_body' => null,
+    //             'status' => 'processing',
+    //             'start_time' => now()
+    //         ]);
+
+    //         // Run the service
+    //         $service_google_sheet = new ServiceGoogleSheet();
+    //         $service_google_sheet->run_service();
+
+    //         // Run the ServicePbgTask with injected Guzzle Client
+    //         $this->service_pbg_task->run_service();
+
+    //         // run the service pbg task assignments
+    //         $this->service_tab_pbg_task->run_service();
+
+    //         // Update the record status to "success" after completion
+    //         $import_datasource->update([
+    //             'status' => 'success',
+    //             'message' => 'Scraping completed successfully.',
+    //             'finish_time' => now()
+    //         ]);
+
+    //     } catch (\Exception $e) {
+
+    //         // Log the error for debugging
+    //         Log::error('Scraping failed: ' . $e->getMessage(), ['trace' => $e->getTraceAsString()]);
+
+    //         // Handle errors by updating the status to "failed"
+    //         if (isset($import_datasource)) {
+    //             $import_datasource->update([
+    //                 'status' => 'failed',
+    //                 'response_body' => 'Error: ' . $e->getMessage(),
+    //                 'finish_time' => now()
+    //             ]);
+    //         }
+    //     }
+    // }
+
+
+}

app/Exports/DistrictPaymentRecapExport.php

@@ -0,0 +1,31 @@
+<?php
+
+namespace App\Exports;
+
+use App\Models\PbgTaskGoogleSheet;
+use Illuminate\Support\Facades\DB;
+use Maatwebsite\Excel\Concerns\FromCollection;
+use Maatwebsite\Excel\Concerns\WithHeadings;
+
+class DistrictPaymentRecapExport implements FromCollection, WithHeadings
+{
+    /**
+    * @return \Illuminate\Support\Collection
+    */
+    public function collection()
+    {
+        return PbgTaskGoogleSheet::select(
+                    'kecamatan',
+                    DB::raw('SUM(nilai_retribusi_keseluruhan_simbg) as total')
+                )
+                ->groupBy('kecamatan')->get();
+    }
+
+    public function headings(): array{
+        return [
+            'Kecamatan',
+            'Total'
+        ];
+    }
+    
+}

app/Exports/ReportDirectorExport.php

@@ -0,0 +1,90 @@
+<?php
+
+namespace App\Exports;
+
+use App\Models\BigdataResume;
+use Maatwebsite\Excel\Concerns\FromCollection;
+use Maatwebsite\Excel\Concerns\WithHeadings;
+use Maatwebsite\Excel\Concerns\WithMapping;
+
+class ReportDirectorExport implements FromCollection, WithHeadings, WithMapping
+{
+    /**
+    * @return \Illuminate\Support\Collection
+    */
+    public function collection()
+    {
+        return BigdataResume::select(
+            'potention_count',
+            'potention_sum',
+            'non_verified_count',
+            'non_verified_sum',
+            'verified_count',
+            'verified_sum',
+            'business_count',
+            'business_sum',
+            'non_business_count',
+            'non_business_sum',
+            'spatial_count',
+            'spatial_sum',
+            'waiting_click_dpmptsp_count',
+            'waiting_click_dpmptsp_sum',
+            'issuance_realization_pbg_count',
+            'issuance_realization_pbg_sum',
+            'process_in_technical_office_count',
+            'process_in_technical_office_sum',
+            'year',
+            'created_at'
+        )->orderBy('id', 'desc')->get();
+    }
+    public function headings(): array{
+        return [
+            "Jumlah Potensi" ,
+            "Total Potensi" ,
+            "Jumlah Berkas Belum Terverifikasi" ,
+            "Total Berkas Belum Terverifikasi" ,
+            "Jumlah Berkas Terverifikasi" ,
+            "Total Berkas Terverifikasi" ,
+            "Jumlah Usaha" ,
+            "Total Usaha" ,
+            "Jumlah Non Usaha" ,
+            "Total Non Usaha" ,
+            "Jumlah Tata Ruang" ,
+            "Total Tata Ruang" ,
+            "Jumlah Menunggu Klik DPMPTSP" ,
+            "Total Menunggu Klik DPMPTSP" ,
+            "Jumlah Realisasi Terbit PBG" ,
+            "Total Realisasi Terbit PBG" ,
+            "Jumlah Proses Dinas Teknis" ,
+            "Total Proses Dinas Teknis", 
+            "Tahun",
+            "Created"
+        ];
+    }
+
+    public function map($row): array
+    {
+        return [
+            $row->potention_count,
+            $row->potention_sum,
+            $row->non_verified_count,
+            $row->non_verified_sum,
+            $row->verified_count,
+            $row->verified_sum,
+            $row->business_count,
+            $row->business_sum,
+            $row->non_business_count,
+            $row->non_business_sum,
+            $row->spatial_count,
+            $row->spatial_sum,
+            $row->waiting_click_dpmptsp_count,
+            $row->waiting_click_dpmptsp_sum,
+            $row->issuance_realization_pbg_count,
+            $row->issuance_realization_pbg_sum,
+            $row->process_in_technical_office_count,
+            $row->process_in_technical_office_sum,
+            $row->year,
+            $row->created_at ? $row->created_at->format('Y-m-d H:i:s') : null, // Format created_at as Y-m-d
+        ];
+    }
+}

app/Exports/ReportPaymentRecapExport.php

@@ -0,0 +1,71 @@
+<?php
+
+namespace App\Exports;
+
+use App\Models\BigdataResume;
+use Maatwebsite\Excel\Concerns\FromCollection;
+use Maatwebsite\Excel\Concerns\WithHeadings;
+
+class ReportPaymentRecapExport implements FromCollection, WithHeadings
+{
+    /**
+    * @return \Illuminate\Support\Collection
+    */
+    protected $startDate;
+    protected $endDate;
+    public function __construct($startDate, $endDate){
+        $this->startDate = $startDate;
+        $this->endDate = $endDate;
+    }
+    public function collection()
+    {
+        $query = BigdataResume::query()->orderBy('id', 'desc');
+
+        if ($this->startDate && $this->endDate) {
+            $query->whereBetween('created_at', [$this->startDate, $this->endDate]);
+        }
+
+        $items = $query->get();
+
+        $categoryMap = [
+            'potention_sum' => 'Potensi',
+            'non_verified_sum' => 'Belum Terverifikasi',
+            'verified_sum' => 'Terverifikasi',
+            'business_sum' => 'Usaha',
+            'non_business_sum' => 'Non Usaha',
+            'spatial_sum' => 'Tata Ruang',
+            'waiting_click_dpmptsp_sum' => 'Menunggu Klik DPMPTSP',
+            'issuance_realization_pbg_sum' => 'Realisasi Terbit PBG',
+            'process_in_technical_office_sum' => 'Proses Di Dinas Teknis',
+        ];
+
+        // Restructure response
+        $data = [];
+
+        foreach ($items as $item) {
+            $createdAt = $item->created_at;
+            $id = $item->id;
+
+            foreach ($item->toArray() as $key => $value) {
+                // Only include columns with "sum" in their names
+                if (strpos($key, 'sum') !== false) {
+                    $data[] = [
+                        'category' => $categoryMap[$key] ?? $key, // Map category
+                        'nominal' => number_format($value, 0, ',', '.'), // Format number
+                        'created_at' => $createdAt->format('Y-m-d H:i:s'), // Format date
+                    ];
+                }
+            }
+        }
+
+        return collect($data);
+    }
+
+    public function headings(): array{
+        return [
+            'Kategori',
+            'Nominal',
+            'Created'
+        ];
+    }
+}

app/Exports/ReportPbgPtspExport.php

@@ -0,0 +1,32 @@
+<?php
+
+namespace App\Exports;
+
+use App\Models\PbgTask;
+use Illuminate\Support\Facades\DB;
+use Maatwebsite\Excel\Concerns\FromCollection;
+use Maatwebsite\Excel\Concerns\WithHeadings;
+
+class ReportPbgPtspExport implements FromCollection, WithHeadings
+{
+    /**
+    * @return \Illuminate\Support\Collection
+    */
+    public function collection()
+    {
+        return PbgTask::select(
+                    'status_name',
+                    DB::raw('COUNT(*) as total')
+                )
+                ->groupBy('status', 'status_name')
+                ->get();
+    }
+
+    public function headings(): array
+    {
+        return [
+            'Status Name',
+            'Total'
+        ];
+    }
+}

app/Exports/ReportTourismExport.php

@@ -0,0 +1,25 @@
+<?php
+
+namespace App\Exports;
+
+use App\Models\TourismBasedKBLI;
+use Maatwebsite\Excel\Concerns\FromCollection;
+use Maatwebsite\Excel\Concerns\WithHeadings;
+
+class ReportTourismExport implements FromCollection, WithHeadings
+{
+    /**
+    * @return \Illuminate\Support\Collection
+    */
+    public function collection()
+    {
+        return TourismBasedKBLI::select('kbli_title', 'total_records')->get();
+    }
+
+    public function headings(): array{
+        return [
+            'Jenis Bisnis Pariwisata',
+            'Jumlah Total'
+        ];
+    }
+}

app/Http/Controllers/Api/AdvertisementController.php

@@ -199,7 +199,7 @@ class AdvertisementController extends Controller
 
     public function downloadExcelAdvertisement()
     {
-        $filePath = storage_path('app/public/templates/template_reklame.xlsx');
+        $filePath = public_path('templates/template_reklame.xlsx');
 
         // Cek apakah file ada
         if (!file_exists($filePath)) {

app/Http/Controllers/Api/BigDataResumeController.php

@@ -0,0 +1,381 @@
+<?php
+
+namespace App\Http\Controllers\Api;
+
+use App\Exports\ReportDirectorExport;
+use App\Exports\ReportPaymentRecapExport;
+use App\Http\Controllers\Controller;
+use App\Http\Resources\BigdataResumeResource;
+use App\Models\BigdataResume;
+use App\Models\DataSetting;
+use Barryvdh\DomPDF\Facade\Pdf;
+use Carbon\Carbon;
+use Illuminate\Http\Request;
+use Illuminate\Support\Facades\Log;
+use Maatwebsite\Excel\Facades\Excel;
+
+class BigDataResumeController extends Controller
+{
+    /**
+     * Display a listing of the resource.
+     */
+    public function index(Request $request)
+    {
+        try{
+            $filterDate = $request->get("filterByDate");
+
+            if (!$filterDate || $filterDate === "latest") {
+                $big_data_resume = BigdataResume::where('year', now()->year)->latest()->first();
+                if (!$big_data_resume) {
+                    return $this->response_empty_resume();
+                }
+            } else {
+                $big_data_resume = BigdataResume::whereDate('created_at', $filterDate)
+                    ->orderBy('id', 'desc')
+                    ->first();
+
+                if (!$big_data_resume) {
+                    return $this->response_empty_resume();
+                }
+            }
+
+            $data_settings = DataSetting::all();
+            if($data_settings->isEmpty()){
+                return response()->json(['message' => 'No data setting found']);
+            }
+
+            function cleanNumber($value) {
+            return floatval(str_replace('.', '', $value));
+            }
+
+            $target_pad = floatval(optional($data_settings->where('key', 'TARGET_PAD')->first())->value);
+            $realisasi_terbit_pbg_sum = cleanNumber(optional($data_settings->where('key', 'REALISASI_TERBIT_PBG_SUM')->first())->value);
+            $realisasi_terbit_pbg_count = cleanNumber(optional($data_settings->where('key', 'REALISASI_TERBIT_PBG_COUNT')->first())->value);
+            $menunggu_klik_dpmptsp_sum = cleanNumber(optional($data_settings->where('key', 'MENUNGGU_KLIK_DPMPTSP_SUM')->first())->value);
+            $menunggu_klik_dpmptsp_count = cleanNumber(optional($data_settings->where('key', 'MENUNGGU_KLIK_DPMPTSP_COUNT')->first())->value);
+            $proses_dinas_teknis_sum = cleanNumber(optional($data_settings->where('key', 'PROSES_DINAS_TEKNIS_SUM')->first())->value);
+            $proses_dinas_teknis_count = cleanNumber(optional($data_settings->where('key', 'PROSES_DINAS_TEKNIS_COUNT')->first())->value);
+            
+            $tata_ruang = $big_data_resume->spatial_sum;
+            $kekurangan_potensi = $target_pad - $big_data_resume->potention_sum;
+
+            // percentage kekurangan potensi
+            $kekurangan_potensi_percentage = $target_pad > 0 && $target_pad > 0 
+            ? round(($kekurangan_potensi / $target_pad) * 100, 2) : 0;
+
+            // percentage total potensi
+            $total_potensi_percentage = $big_data_resume->potention_sum > 0 && $target_pad > 0 
+            ? round(($big_data_resume->potention_sum / $target_pad) * 100, 2) : 0;
+            
+            // percentage verified document
+            $verified_percentage = $big_data_resume->verified_sum > 0 && $big_data_resume->potention_sum > 0 
+            ? round(($big_data_resume->verified_sum / $big_data_resume->potention_sum) * 100, 2) : 0;
+
+            // percentage non-verified document
+            $non_verified_percentage = $big_data_resume->non_verified_sum > 0 && $big_data_resume->potention_sum > 0 
+            ? round(($big_data_resume->non_verified_sum / $big_data_resume->potention_sum) * 100, 2) : 0;
+
+            // percentage business document
+            $business_percentage = $big_data_resume->business_sum > 0 && $big_data_resume->non_verified_sum > 0 
+            ? round(($big_data_resume->business_sum / $big_data_resume->non_verified_sum) * 100, 2) : 0;
+
+            // percentage non-business document
+            $non_business_percentage = $big_data_resume->non_business_sum > 0 && $big_data_resume->potention_sum > 0 
+            ? round(($big_data_resume->non_business_sum / $big_data_resume->potention_sum) * 100, 2) : 0;
+
+            // percentage tata ruang
+            $tata_ruang_percentage = $tata_ruang > 0 && $big_data_resume->potention_sum > 0 
+            ? round(($tata_ruang / $big_data_resume->potention_sum) * 100, 2) : 0;
+
+            // percentage realisasi terbit pbg
+            $realisasi_terbit_percentage = $big_data_resume->verified_sum > 0 && $realisasi_terbit_pbg_sum > 0
+            ? round(($realisasi_terbit_pbg_sum / $big_data_resume->verified_sum) * 100, 2) : 0;
+
+            // percentage menunggu klik dpmptsp
+            $menunggu_klik_dpmptsp_percentage = $big_data_resume->verified_sum > 0 && $menunggu_klik_dpmptsp_sum > 0
+            ? round(($menunggu_klik_dpmptsp_sum / $big_data_resume->verified_sum) * 100, 2) : 0;
+
+            // percentage proses_dinas_teknis
+            $proses_dinas_teknis_percentage = $big_data_resume->verified_sum > 0 && $proses_dinas_teknis_sum > 0
+            ? round(($proses_dinas_teknis_sum / $big_data_resume->verified_sum) * 100, 2) : 0;
+
+            $result = [
+                'target_pad' => [
+                    'sum' => $target_pad,
+                    'percentage' => 100,
+                ],
+                'tata_ruang' => [
+                    'sum' => $big_data_resume->spatial_sum,
+                    'count' => $big_data_resume->spatial_count,
+                    'percentage' => $tata_ruang_percentage,
+                ],
+                'kekurangan_potensi' => [
+                    'sum' => $kekurangan_potensi,
+                    'percentage' => $kekurangan_potensi_percentage
+                ],
+                'total_potensi' => [
+                    'sum' => (float) $big_data_resume->potention_sum,
+                    'count' => $big_data_resume->potention_count,
+                    'percentage' => $total_potensi_percentage
+                ],
+                'verified_document' => [
+                    'sum' => (float) $big_data_resume->verified_sum,
+                    'count' => $big_data_resume->verified_count,
+                    'percentage' => $verified_percentage
+                ],
+                'non_verified_document' => [
+                    'sum' => (float) $big_data_resume->non_verified_sum,
+                    'count' => $big_data_resume->non_verified_count,
+                    'percentage' => $non_verified_percentage
+                ],
+                'business_document' => [
+                    'sum' => (float) $big_data_resume->business_sum,
+                    'count' => $big_data_resume->business_count,
+                    'percentage' => $business_percentage
+                ],
+                'non_business_document' => [
+                    'sum' => (float) $big_data_resume->non_business_sum,
+                    'count' => $big_data_resume->non_business_count,
+                    'percentage' => $non_business_percentage
+                ],
+                'realisasi_terbit' => [
+                    'sum' => $realisasi_terbit_pbg_sum,
+                    'count' => $realisasi_terbit_pbg_count,
+                    'percentage' => $realisasi_terbit_percentage
+                ],
+                'menunggu_klik_dpmptsp' => [
+                    'sum' => $menunggu_klik_dpmptsp_sum,
+                    'count' => $menunggu_klik_dpmptsp_count,
+                    'percentage' => $menunggu_klik_dpmptsp_percentage
+                ],
+                'proses_dinas_teknis' => [
+                    'sum' => $proses_dinas_teknis_sum,
+                    'count' => $proses_dinas_teknis_count,
+                    'percentage' => $proses_dinas_teknis_percentage
+                ]
+            ];
+            return response()->json($result);
+        }catch(\Exception $e){
+            return response()->json(['message' => 'Error when fetching data'], 500);
+        }
+    }
+
+
+
+    public function bigdata_report(Request $request){
+        try{
+            $query = BigdataResume::query()->orderBy('id', 'desc');
+        
+            if($request->filled('search')){
+                $query->where('year', 'LIKE', '%'.$request->input('search').'%');
+            }
+
+            $query = $query->paginate(config('app.paginate_per_page', 50));
+            return  BigdataResumeResource::collection($query)->response()->getData(true);
+        }catch(\Exception $e){
+            Log::error($e->getMessage());
+            return response()->json(['message' => 'Error when fetching data'], 500);
+        }
+    }
+
+    public function payment_recaps(Request $request)
+    {
+        try {
+            $query = BigdataResume::query()->orderBy('id', 'desc');
+
+            if ($request->filled('start_date') && $request->filled('end_date')) {
+                $startDate = Carbon::parse($request->input('start_date'))->startOfDay();
+                $endDate = Carbon::parse($request->input('end_date'))->endOfDay();
+
+                $query->whereBetween('created_at', [$startDate, $endDate]);
+            }
+
+            $data = $query->paginate(50);
+
+            // Restructure response
+            $transformedData = [];
+
+            foreach ($data as $item) {
+                $createdAt = $item->created_at;
+                $id = $item->id;
+
+                foreach ($item->toArray() as $key => $value) {
+                    // Only include columns with "sum" in their names
+                    if (strpos($key, 'sum') !== false) {
+                        $transformedData[] = [
+                            'id' => $id,
+                            'category' => $key,
+                            'nominal' => $value,
+                            'created_at' => $createdAt,
+                        ];
+                    }
+                }
+            }
+
+            return response()->json([
+                'data' => $transformedData, // Flat array
+                'pagination' => [
+                    'total' => count($transformedData),
+                    'per_page' => $data->perPage(),
+                    'current_page' => $data->currentPage(),
+                    'last_page' => $data->lastPage(),
+                ]
+            ]);
+        } catch (\Exception $e) {
+            Log::error($e->getMessage());
+            return response()->json(['message' => 'Error when fetching data'], 500);
+        }
+    }
+
+    public function export_excel_payment_recaps(Request $request)
+    {
+        $startDate = null;
+        $endDate = null;
+
+        if ($request->filled('start_date') && $request->filled('end_date')) {
+            $startDate = Carbon::parse($request->input('start_date'))->startOfDay();
+            $endDate = Carbon::parse($request->input('end_date'))->endOfDay();
+        }
+
+        return Excel::download(new ReportPaymentRecapExport($startDate, $endDate), 'laporan-rekap-pembayaran.xlsx');
+    }
+
+    public function export_pdf_payment_recaps(Request $request){
+        $query = BigdataResume::query()->orderBy('id', 'desc');
+
+        if ($request->filled('start_date') && $request->filled('end_date')) {
+            $startDate = Carbon::parse($request->input('start_date'))->startOfDay();
+            $endDate = Carbon::parse($request->input('end_date'))->endOfDay();
+
+            $query->whereBetween('created_at', [$startDate, $endDate]);
+        }
+
+        $items = $query->get();
+
+        // Define category mapping
+        $categoryMap = [
+            'potention_sum' => 'Potensi',
+            'non_verified_sum' => 'Belum Terverifikasi',
+            'verified_sum' => 'Terverifikasi',
+            'business_sum' => 'Usaha',
+            'non_business_sum' => 'Non Usaha',
+            'spatial_sum' => 'Tata Ruang',
+            'waiting_click_dpmptsp_sum' => 'Menunggu Klik DPMPTSP',
+            'issuance_realization_pbg_sum' => 'Realisasi Terbit PBG',
+            'process_in_technical_office_sum' => 'Proses Di Dinas Teknis',
+        ];
+
+        // Restructure response
+        $data = [];
+
+        foreach ($items as $item) {
+            $createdAt = $item->created_at;
+            $id = $item->id;
+
+            foreach ($item->toArray() as $key => $value) {
+                // Only include columns with "sum" in their names
+                if (strpos($key, 'sum') !== false) {
+                    $data[] = [
+                        'id' => $id,
+                        'category' => $categoryMap[$key] ?? $key, // Map category
+                        'nominal' => $value, // Format number
+                        'created_at' => $createdAt->format('Y-m-d H:i:s'), // Format date
+                    ];
+                }
+            }
+        }
+
+        $pdf = Pdf::loadView('exports.payment_recaps_report', compact('data'));
+        return $pdf->download('laporan-rekap-pembayaran.pdf');
+    }
+
+
+    public function export_excel_report_director(){
+        return Excel::download(new ReportDirectorExport, 'laporan-pimpinan.xlsx');
+    }
+
+    public function export_pdf_report_director(){
+        $data = BigdataResume::select(
+            'potention_count',
+            'potention_sum',
+            'non_verified_count',
+            'non_verified_sum',
+            'verified_count',
+            'verified_sum',
+            'business_count',
+            'business_sum',
+            'non_business_count',
+            'non_business_sum',
+            'spatial_count',
+            'spatial_sum',
+            'waiting_click_dpmptsp_count',
+            'waiting_click_dpmptsp_sum',
+            'issuance_realization_pbg_count',
+            'issuance_realization_pbg_sum',
+            'process_in_technical_office_count',
+            'process_in_technical_office_sum',
+            'year',
+            'created_at'
+        )->orderBy('id', 'desc')->get();
+        $pdf = Pdf::loadView('exports.director_report', compact('data'))->setPaper('a4', 'landscape');
+        return $pdf->download('laporan-pimpinan.pdf');
+    }
+    private function response_empty_resume(){
+        $result = [
+            'target_pad' => [
+                'sum' => 0,
+                'percentage' => 100,
+            ],
+            'tata_ruang' => [
+                'sum' => 0,
+                'percentage' => 0,
+            ],
+            'kekurangan_potensi' => [
+                'sum' => 0,
+                'percentage' => 0
+            ],
+            'total_potensi' => [
+                'sum' => 0,
+                'count' => 0,
+                'percentage' => 0
+            ],
+            'verified_document' => [
+                'sum' => 0,
+                'count' => 0,
+                'percentage' => 0
+            ],
+            'non_verified_document' => [
+                'sum' => 0,
+                'count' => 0,
+                'percentage' => 0
+            ],
+            'business_document' => [
+                'sum' => 0,
+                'count' => 0,
+                'percentage' => 0
+            ],
+            'non_business_document' => [
+                'sum' => 0,
+                'count' => 0,
+                'percentage' => 0
+            ],
+            'realisasi_terbit' => [
+                'sum' => 0,
+                'count' => 0,
+                'percentage' => 0
+            ],
+            'menunggu_klik_dpmptsp' => [
+                'sum' => 0,
+                'count' => 0,
+                'percentage' => 0
+            ],
+            'proses_dinas_teknis' => [
+                'sum' => 0,
+                'count' => 0,
+                'percentage' => 0
+            ]
+        ];
+
+        return response()->json($result);
+    }
+}

app/Http/Controllers/Api/BusinessOrIndustriesController.php

@@ -9,6 +9,7 @@ use App\Models\BusinessOrIndustry;
 use Illuminate\Http\Request;
 use Maatwebsite\Excel\Facades\Excel;
 use \Illuminate\Support\Facades\Validator;
+use App\Http\Requests\ExcelUploadRequest;
 class BusinessOrIndustriesController extends Controller
 {
     /**
@@ -30,7 +31,7 @@ class BusinessOrIndustriesController extends Controller
             });
         }
 
-        return response()->json($query->paginate());
+        return response()->json($query->paginate(config('app.paginate_per_page', 50)));
     }
 
     /**
@@ -79,29 +80,15 @@ class BusinessOrIndustriesController extends Controller
         }
     }
 
-    public function upload(Request $request){
+    public function upload(ExcelUploadRequest $request){
-
-        if ($request->hasFile('file')) {
-            $file = $request->file('file');
-        }
-
-        // Validasi file
-        $validator = Validator::make($request->all(), [
-            'file' => 'required|mimes:xlsx,xls|max:102400', // Max 100MB
-        ]);
-
-        if ($validator->fails()) {
-            return response()->json([
-                'message' => 'File validation failed.',
-                'errors' => $validator->errors()
-            ], 400);
-        }
-
         try {
-            // Ambil file dari request
+            if(!$request->hasFile('file')){
-            $file = $request->file('file');
+                return response()->json([
+                   'error' => 'No file provided'
+                ], 400);
+            }
 
-            // Menggunakan Laravel Excel untuk mengimpor file
+            $file = $request->file('file');
             Excel::import(new BusinessIndustriesImport, $file);
 
             // Jika sukses, kembalikan respons sukses

app/Http/Controllers/Api/ChatbotController.php

@@ -0,0 +1,119 @@
+<?php
+
+namespace App\Http\Controllers\Api;
+
+use Illuminate\Http\Request;
+use App\Services\OpenAIService;
+use App\Http\Controllers\Controller;
+use Illuminate\Http\Response;
+use Illuminate\Support\Facades\DB;
+use Illuminate\Support\Facades\Log;
+
+class ChatbotController extends Controller
+{
+    protected $openAIService;
+
+    public function __construct(OpenAIService $openAIService)
+    {
+        $this->openAIService = $openAIService;
+    }
+
+    public function generateText(Request $request)
+    {
+        $request->validate([
+            'tab_active' => 'required|string',
+            'prompt' => 'required|string',
+        ]);
+
+        $tab_active = $request->input('tab_active');
+        $main_content = match ($tab_active) {
+            "count-retribusi" => "RETRIBUTION",
+            "document-validation" => "DOCUMENT VALIDATION",
+            "data-information" => "DATA SUMMARY",
+            default => "UNKNOWN",
+        };
+
+        $chatHistory = $request->input('chatHistory');
+        // Log::info('Chat history sebelum disimpan:', ['history' => $chatHistory]);
+
+        if ($main_content === "UNKNOWN") {
+            return response()->json(['response' => 'Invalid tab_active value.'], 400);
+        }
+
+        // info($main_content);
+
+        $queryResponse = $this->openAIService->generateQueryBasedMainContent($request->input('prompt'), $main_content, $chatHistory);
+        
+        $firstValidation = $this->openAIService->validateSyntaxQuery($queryResponse);
+        $secondValidation = $this->openAIService->validateSyntaxQuery($queryResponse);
+
+        $formattedResultQuery = "[]";
+        $queryResponse = str_replace(['```sql', '```'], '', $queryResponse);
+        $resultQuery = DB::select($queryResponse);
+        $formattedResultQuery = json_encode($resultQuery, JSON_PRETTY_PRINT);
+        // info($formattedResultQuery);
+        
+        $nlpResult = $this->openAIService->generateNLPFromQuery($request->input('prompt'), $formattedResultQuery);
+        $finalGeneratedText =$this->openAIService->generateFinalText($nlpResult);
+        return response()->json(['response' => $finalGeneratedText, 'nlpResponse' => $queryResponse]);
+    }
+
+    public function mainGenerateText(Request $request)
+    {
+        // Log hanya data yang relevan
+        info("Received prompt: " . $request->input('prompt'));
+
+        // Validasi input
+        $request->validate([
+            'prompt' => 'required|string',
+        ]);
+
+        try {
+            // Panggil service untuk generate text
+            $classifyResponse = $this->openAIService->classifyMainGenerateText($request->input('prompt'));
+            info($classifyResponse);
+
+            // Pastikan hasil klasifikasi valid sebelum melanjutkan
+            $validCategories = [
+                'reklame', 'business_or_industries', 'customers', 
+                'pbg', 'retribusi', 'spatial_plannings', 
+                'tourisms', 'umkms'
+            ];
+
+            if (!in_array($classifyResponse, $validCategories)) {
+                return response()->json([
+                    'error' => ''
+                ], 400);
+            }
+
+            $chatHistory = $request->input('chatHistory');
+            Log::info('Chat history sebelum disimpan:', ['history' => $chatHistory]);
+
+            $queryResponse = $this->openAIService->createMainQuery($classifyResponse, $request->input('prompt'), $chatHistory);
+            info($queryResponse);
+
+            $firstValidation = $this->openAIService->validateSyntaxQuery($queryResponse);
+            $secondValidation = $this->openAIService->validateSyntaxQuery($queryResponse);
+
+            $formattedResultQuery = "[]";
+            
+            $queryResponse = str_replace(['```sql', '```'], '', $queryResponse);
+            $queryResult = DB::select($queryResponse);
+            
+            $formattedResultQuery = json_encode($queryResult, JSON_PRETTY_PRINT);
+            
+            $nlpResult = $this->openAIService->generateNLPFromQuery($request->input('prompt'), $formattedResultQuery);
+            $finalGeneratedText =$this->openAIService->generateFinalText($nlpResult);
+            
+            return response()->json(['response' => $finalGeneratedText, 'nlpResponse' => $queryResponse]);
+        } catch (\Exception $e) {
+            // Tangani error dan log exception
+            \Log::error("Error generating text: " . $e->getMessage());
+
+            return response()->json([
+                'error' => ''
+            ], 500);
+        }
+    }
+
+}

app/Http/Controllers/Api/CustomersController.php

@@ -0,0 +1,130 @@
+<?php
+
+namespace App\Http\Controllers\Api;
+
+use App\Http\Controllers\Controller;
+use App\Http\Requests\CustomersRequest;
+use App\Http\Requests\ExcelUploadRequest;
+use App\Http\Resources\CustomersResource;
+use App\Imports\CustomersImport;
+use App\Models\Customer;
+use Illuminate\Http\Request;
+use Maatwebsite\Excel\Facades\Excel;
+
+class CustomersController extends Controller
+{
+    /**
+     * Display a listing of the resource.
+     */
+    public function index(Request $request)
+    {
+        $query = Customer::query()->orderBy('id', 'desc');
+        if ($request->has('search') &&!empty($request->get('search'))) {
+            $query = $query->where('nomor_pelanggan', 'LIKE', '%'.$request->get('search').'%')
+                ->orWhere('nama', 'LIKE', '%'.$request->get('search').'%')
+                ->orWhere('kota_pelayanan', 'LIKE', '%'.$request->get('search').'%');
+        }
+        return CustomersResource::collection($query->paginate(config('app.paginate_per_page', 50)));
+    }
+
+    /**
+     * Store a newly created resource in storage.
+     */
+    public function store(CustomersRequest $request)
+    {
+        try{
+            $customer = Customer::create($request->validated());
+            return response()->json(['message' => 'Successfully created', new CustomersResource($customer)]);
+        }catch(\Exception $e){
+            return response()->json([
+                'message' => 'Failed to create customer',
+                'error' => $e->getMessage()
+            ], 500);
+        }
+    }
+
+    /**
+     * Display the specified resource.
+     */
+    public function show(string $id)
+    {
+        try{
+            $customer = Customer::find($id);
+            if($customer){
+                return new CustomersResource($customer);
+            } else {
+                return response()->json(['message' => 'Customer not found'], 404);
+            }
+        }catch(\Exception $e){
+            return response()->json([
+                'message' => 'Failed to retrieve customer',
+                'error' => $e->getMessage()
+            ], 500);
+        }
+    }
+
+    /**
+     * Update the specified resource in storage.
+     */
+    public function update(CustomersRequest $request, string $id)
+    {
+        try{
+            $customer = Customer::find($id);
+            if($customer){
+                $customer->update($request->validated());
+                return response()->json(['message' => 'Successfully updated', new CustomersResource($customer)]);
+            } else {
+                return response()->json(['message' => 'Customer not found'], 404);
+            }
+        }catch(\Exception $e) {
+            return response()->json([
+                'message' => 'Failed to update customer',
+                'error' => $e->getMessage()
+            ], 500);
+        }
+    }
+
+    /**
+     * Remove the specified resource from storage.
+     */
+    public function destroy(string $id)
+    {
+        try{
+            $customer = Customer::find($id);
+            if($customer){
+                $customer->delete();
+                return response()->json(['message' => 'Successfully deleted']);
+            }else {
+                return response()->json(['message' => 'Customer not found'], 404);
+            }
+        }catch(\Exception $e) {
+            return response()->json([
+                'message' => 'Failed to delete customer',
+                'error' => $e->getMessage()
+            ], 500);
+        }
+    }
+
+    public function upload(ExcelUploadRequest $request){
+        try{
+            if(!$request->hasFile('file')){
+                return response()->json([
+                   'error' => 'No file provided'
+                ], 400);
+            }
+
+            $file = $request->file('file');
+            Excel::import(new CustomersImport, $file);
+
+            return response()->json([
+                'message' => 'File uploaded successfully',
+            ]);
+        }catch(\Exception $e){
+            \Log::info($e->getMessage());
+            return response()->json([
+                'error' => 'Failed to upload file',
+               'message' => $e->getMessage()
+            ], 500);
+        }
+    }
+}

app/Http/Controllers/Api/GlobalSettingsController.php

@@ -34,7 +34,7 @@ class GlobalSettingsController extends Controller
         try {
             $data = GlobalSetting::create($request->validated());
             return new GlobalSettingResource($data);
-        } catch (\Exception $e) {
+        } catch (Exception $e) {
             return $this->resError($e->getMessage(), null, $e->getCode());
         }
     }

app/Http/Controllers/Api/GoogleSheetController.php

@@ -3,33 +3,15 @@
 namespace App\Http\Controllers\Api;
 
 use App\Http\Controllers\Controller;
-use App\Services\GoogleSheetService;
 use Illuminate\Http\Request;
 
 class GoogleSheetController extends Controller
 {
-    protected $googleSheetService;
+    public function index(Request $request)
-    public function __construct(GoogleSheetService $googleSheetService){
-        $this->googleSheetService = $googleSheetService;
-    }
-    /**
-     * Display a listing of the resource.
-     */
-    public function index()
     {
-        $dataCollection = $this->googleSheetService->getSheetDataCollection();
+        
-        $result = [
-            "last_row" => $this->googleSheetService->getLastRowByColumn("C"),
-            "last_column" => $this->googleSheetService->getLastColumn(),
-            "header" => $this->googleSheetService->getHeader(),
-            "data_collection" => $dataCollection
-        ];
-        return response()->json($result);
     }
 
-    /**
-     * Store a newly created resource in storage.
-     */
     public function store(Request $request)
     {
         //

app/Http/Controllers/Api/ImportDatasourceController.php

@@ -24,7 +24,7 @@ class ImportDatasourceController extends Controller
             $search = $request->get("search");
             $query->where('status', 'like', "%".$search."%");
         }
-        return ImportDatasourceResource::collection($query->paginate());
+        return ImportDatasourceResource::collection($query->paginate(config('app.paginate_per_page', 50)));
     }
 
     public function checkImportDatasource(){

app/Http/Controllers/Api/LackOfPotentialController.php

@@ -0,0 +1,34 @@
+<?php
+
+namespace App\Http\Controllers\Api;
+
+use App\Http\Controllers\Controller;
+use App\Models\Advertisement;
+use App\Models\Customer;
+use App\Models\SpatialPlanning;
+use Illuminate\Http\Request;
+use App\Models\TourismBasedKBLI;
+
+class LackOfPotentialController extends Controller
+{
+
+    public function count_lack_of_potential(){
+        try{
+            $total_reklame = Advertisement::count();
+            $total_pdam = Customer::count();
+            $total_tata_ruang = SpatialPlanning::count();
+            $data_report_tourism = TourismBasedKBLI::all();
+
+            return response()->json([
+                'total_reklame' => $total_reklame,
+                'total_pdam' => $total_pdam,
+                'total_tata_ruang' => $total_tata_ruang,
+                'data_report' => $data_report_tourism,
+            ], 200);
+        }catch(\Exception $e){
+            return response()->json([
+                'message' => 'Error: '.$e->getMessage()
+            ], 500);
+        }
+    }
+}

app/Http/Controllers/Api/MenusController.php

@@ -3,8 +3,11 @@
 namespace App\Http\Controllers\Api;
 
 use App\Http\Controllers\Controller;
+use App\Http\Requests\MenuRequest;
+use App\Http\Resources\MenuResource;
 use App\Models\Menu;
 use Illuminate\Http\Request;
+use Illuminate\Support\Facades\Log;
 
 class MenusController extends Controller
 {
@@ -13,21 +16,28 @@ class MenusController extends Controller
      */
     public function index(Request $request)
     {
-        $query = Menu::query();
+        $query = Menu::query()->orderBy('id', 'desc');
 
         if($request->has("search") && !empty($request->get("search"))){
             $query = $query->where("name", "like", "%".$request->get("search")."%");
         }
 
-        return response()->json($query->paginate());
+        // return response()->json($query->paginate(config('app.paginate_per_page', 50)));
+        return MenuResource::collection($query->paginate(config('app.paginate_per_page',50)));
     }
 
     /**
      * Store a newly created resource in storage.
      */
-    public function store(Request $request)
+    public function store(MenuRequest $request)
     {
-        //
+        try{
+            $menu = Menu::create($request->validated());
+            return response()->json(['message' => 'Menu created successfully', 'data' => new MenuResource($menu)]);
+        }catch(\Exception $e){
+            Log::error($e);
+            return response()->json(['message' => 'Error when creating menu'], 500);
+        }
     }
 
     /**
@@ -35,15 +45,37 @@ class MenusController extends Controller
      */
     public function show(string $id)
     {
-        //
+        try{
+            $menu = Menu::find($id);
+            if($menu){
+                return response()->json(['message' => 'Menu found', 'data' => new MenuResource($menu)]);
+            } else {
+                return response()->json(['message' => 'Menu not found'], 404);
+            }
+        }catch(\Exception $e){
+            Log::error($e);
+            Log::error($e->getMessage());
+            return response()->json(['message' => 'Error when finding menu'], 500);
+        }
     }
 
     /**
      * Update the specified resource in storage.
      */
-    public function update(Request $request, string $id)
+    public function update(MenuRequest $request, string $id)
     {
-        //
+        try{
+            $menu = Menu::findOrFail($id);
+            if($menu){
+                $menu->update($request->validated());
+                return response()->json(['message' => 'Menu updated successfully', 'data' => new MenuResource($menu)]);
+            } else {
+                return response()->json(['message' => 'Menu not found'], 404);
+            }
+        }catch(\Exception $e){
+            Log::error($e);
+            return response()->json(['message' => 'Error when updating menu'], 500);
+        }
     }
 
     /**
@@ -51,6 +83,28 @@ class MenusController extends Controller
      */
     public function destroy(string $id)
     {
-        //
+        try{
+            $menu = Menu::findOrFail($id);
+            if($menu){
+                $this->deleteChildren($menu);
+                $menu->roles()->detach();
+                $menu->delete();
+                return response()->json(['message' => 'Menu deleted successfully']);
+            } else {
+                return response()->json(['message' => 'Menu not found'], 404);
+            }
+        }catch(\Exception $e){
+            Log::error($e);
+            return response()->json(['message' => 'Error when deleting menu'], 500);
+        }
+    }
+
+    private function deleteChildren($menu)
+    {
+        foreach ($menu->children as $child) {
+            $this->deleteChildren($child); // Recursively delete its children
+            $child->roles()->detach(); // Detach roles before deleting
+            $child->delete();
+        }
     }
 }

app/Http/Controllers/Api/PbgTaskController.php

@@ -21,9 +21,35 @@ class PbgTaskController extends Controller
     public function __construct(GoogleSheetService $googleSheetService){
         $this->googleSheetService = $googleSheetService;
     }
-    public function index()
+    public function index(Request $request)
     {
-        //
+        info($request);
+        
+        $isLastUpdated = filter_var($request->query('isLastUpdated', false), FILTER_VALIDATE_BOOLEAN);
+
+        $query = PbgTask::query();
+
+        if ($isLastUpdated) {
+            $query->orderBy('updated_at', 'desc');
+        } else {
+            $query->where('status', 20);
+        }
+
+        // Ambil maksimal 10 data
+        $pbg_task = $query->limit(10)->get();
+        $totalData = $pbg_task->count();
+
+        // Tambahkan nomor urut
+        $data = $pbg_task->map(function ($item, $index) {
+            return array_merge($item->toArray(), ['no' => $index + 1]);
+        });
+
+        return response()->json([
+            'data' => $data,
+            'meta' => [
+                'total' => $totalData
+            ]
+        ]);
     }
 
     /**

app/Http/Controllers/Api/PbgTaskGoogleSheetsController.php

@@ -0,0 +1,61 @@
+<?php
+
+namespace App\Http\Controllers\Api;
+
+use App\Http\Controllers\Controller;
+use App\Http\Resources\PbgTaskGoogleSheetResource;
+use App\Models\PbgTaskGoogleSheet;
+use Illuminate\Http\Request;
+
+class PbgTaskGoogleSheetsController extends Controller
+{
+    /**
+     * Display a listing of the resource.
+     */
+    public function index(Request $request)
+    {
+        $query = PbgTaskGoogleSheet::query()->orderBy('id', 'desc');
+        if ($request->filled('search')) {
+            $query->where('no_registrasi', 'like', "%{$request->get('search')}%");
+        }
+        return PbgTaskGoogleSheetResource::collection($query->paginate(config('app.paginate_per_page', 50)));
+    }
+
+    /**
+     * Store a newly created resource in storage.
+     */
+    public function store(Request $request)
+    {
+        //
+    }
+
+    /**
+     * Display the specified resource.
+     */
+    public function show(string $id)
+    {
+        //
+    }
+
+    /**
+     * Update the specified resource in storage.
+     */
+    public function update(Request $request, string $id)
+    {
+        //
+    }
+
+    /**
+     * Remove the specified resource from storage.
+     */
+    public function destroy(string $id)
+    {
+        try{
+            $data = PbgTaskGoogleSheet::find($id);
+            $data->delete();
+            return response()->json(['message' => 'Data deleted successfully'], 200);
+        }catch(\Exception $e){
+            return response()->json(['message' => 'Failed to delete data'], 500);
+        }
+    }
+}

app/Http/Controllers/Api/ReportPbgPtspController.php

@@ -0,0 +1,29 @@
+<?php
+
+namespace App\Http\Controllers\Api;
+
+use App\Exports\ReportPbgPtspExport;
+use App\Http\Controllers\Controller;
+use App\Models\PbgTask;
+use Barryvdh\DomPDF\Facade\Pdf;
+use Illuminate\Http\Request;
+use Illuminate\Support\Facades\DB;
+use Maatwebsite\Excel\Facades\Excel;
+
+class ReportPbgPtspController extends Controller
+{
+    public function export_excel(){
+        return Excel::download(new ReportPbgPtspExport, 'laporan-ptsp.xlsx');
+    }
+    public function export_pdf(){
+        $data = PbgTask::select(
+                    'status',
+                    'status_name', // Keeping this column
+                    DB::raw('COUNT(*) as total')
+                )
+                ->groupBy('status', 'status_name')
+                ->get();
+        $pdf = Pdf::loadView('exports.ptsp_report', compact('data'));
+        return $pdf->download('laporan-ptsp.pdf');
+    }
+}

app/Http/Controllers/Api/ReportTourismsController.php

@@ -0,0 +1,22 @@
+<?php
+
+namespace App\Http\Controllers\Api;
+
+use App\Exports\ReportTourismExport;
+use App\Http\Controllers\Controller;
+use App\Models\TourismBasedKBLI;
+use Barryvdh\DomPDF\Facade\Pdf;
+use Illuminate\Http\Request;
+use Maatwebsite\Excel\Facades\Excel;
+
+class ReportTourismsController extends Controller
+{
+    public function export_excel(){
+        return Excel::download(new ReportTourismExport, 'laporan-pariwisata.xlsx');
+    }
+    public function export_pdf(){
+        $data = TourismBasedKBLI::all();
+        $pdf = Pdf::loadView('exports.tourisms_report', compact('data'));
+        return $pdf->download('laporan-pariwisata.pdf');
+    }
+}

app/Http/Controllers/Api/RequestAssignmentController.php

@@ -2,10 +2,17 @@
 
 namespace App\Http\Controllers\Api;
 
+use App\Exports\DistrictPaymentRecapExport;
 use App\Http\Controllers\Controller;
 use App\Http\Resources\RequestAssignmentResouce;
 use App\Models\PbgTask;
+use App\Models\PbgTaskGoogleSheet;
+use Barryvdh\DomPDF\Facade\Pdf;
+use DB;
+use Exception;
 use Illuminate\Http\Request;
+use Log;
+use Maatwebsite\Excel\Facades\Excel;
 
 class RequestAssignmentController extends Controller
 {
@@ -17,11 +24,70 @@ class RequestAssignmentController extends Controller
         $query = PbgTask::query()->orderBy('id', 'desc');
         if($request->has('search') && !empty($request->get("search"))){
             $query->where('name', 'LIKE', '%'.$request->get('search').'%')
-            ->orWhere('registration_number', 'LIKE', '%'.$request->get('search').'%');
+            ->orWhere('registration_number', 'LIKE', '%'.$request->get('search').'%')
+            ->orWhere('document_number', 'LIKE', '%'.$request->get('search').'%');
         }
         return RequestAssignmentResouce::collection($query->paginate());
     }
 
+    public function report_payment_recaps(Request $request)
+    {
+        try {
+            // Query dengan group by kecamatan dan sum nilai_retribusi_keseluruhan_simbg
+            $query = PbgTaskGoogleSheet::select(
+                    'kecamatan',
+                    DB::raw('SUM(nilai_retribusi_keseluruhan_simbg) as total')
+                )
+                ->groupBy('kecamatan')
+                ->paginate(10);
+
+            // Return hasil dalam JSON format
+            return response()->json([
+                'success' => true,
+                'data' => $query
+            ]);
+
+        } catch (Exception $e) {
+            Log::error($e->getMessage());
+            return response()->json(['message' => 'Terjadi kesalahan: ' . $e->getMessage()], 500);
+        }
+    }
+
+    public function export_excel_district_payment_recaps(){
+        return Excel::download(new DistrictPaymentRecapExport, 'laporan-rekap-data-pembayaran.xlsx');
+    }
+    public function export_pdf_district_payment_recaps(){
+        $data = PbgTaskGoogleSheet::select(
+                    'kecamatan',
+                    DB::raw('SUM(nilai_retribusi_keseluruhan_simbg) as total')
+                )
+                ->groupBy('kecamatan')->get();
+        $pdf = Pdf::loadView('exports.district_payment_report', compact('data'));
+        return $pdf->download('laporan-rekap-data-pembayaran.pdf');
+    }
+    public function report_pbg_ptsp()
+    {
+        try {
+            // Query dengan group by status dan count total per status
+            $query = PbgTask::select(
+                    'status',
+                    'status_name',
+                    DB::raw('COUNT(*) as total')
+                )
+                ->groupBy('status', 'status_name')
+                ->paginate(10);
+
+            // Return hasil dalam JSON format
+            return response()->json([
+                'success' => true,
+                'data' => $query
+            ]);
+
+        } catch (Exception $e) {
+            Log::error($e->getMessage());
+            return response()->json(['message' => 'Terjadi kesalahan: ' . $e->getMessage()], 500);
+        }
+    }
     /**
      * Store a newly created resource in storage.
      */

app/Http/Controllers/Api/RolesController.php

@@ -3,6 +3,7 @@
 namespace App\Http\Controllers\Api;
 
 use App\Http\Controllers\Controller;
+use App\Http\Requests\RoleRequest;
 use App\Models\Role;
 use Illuminate\Http\Request;
 
@@ -13,21 +14,26 @@ class RolesController extends Controller
      */
     public function index(Request $request)
     {
-        $query = Role::query();
+        $query = Role::query()->orderBy('id', 'desc');
 
         if($request->has('search') && !empty($request->get('search'))){
             $query = $query->where('name', 'like', '%'. $request->get('search') . '%');
         }
 
-        return response()->json($query->paginate());
+        return response()->json($query->paginate(config('app.paginate_per_page', 50)));
     }
 
     /**
      * Store a newly created resource in storage.
      */
-    public function store(Request $request)
+    public function store(RoleRequest $request)
     {
-        //
+        try{
+            $role = Role::create($request->validated());
+            return response()->json(['message' => 'Successfully created', 'data' => $role]);
+        }catch(\Exception $e){
+            return response()->json(['message' => 'Error when creating role', 'error' => $e->getMessage()], 500);
+        }
     }
 
     /**
@@ -35,15 +41,34 @@ class RolesController extends Controller
      */
     public function show(string $id)
     {
-        //
+        try{
+            $role = Role::find($id);
+            if($role){
+                return response()->json(['data' => $role]);
+            } else {
+                return response()->json(['message' => 'Role not found'], 404);
+            }
+        }catch(\Exception $e){
+            return response()->json(['message' => 'Error when getting role', 'error' => $e->getMessage()], 500);
+        }
     }
 
     /**
      * Update the specified resource in storage.
      */
-    public function update(Request $request, string $id)
+    public function update(RoleRequest $request, string $id)
     {
-        //
+        try{
+            $role = Role::find($id);
+            if($role){
+                $role->update($request->validated());
+                return response()->json(['message' => 'Successfully updated', 'data' => $role]);
+            } else {
+                return response()->json(['message' => 'Role not found'], 404);
+            }
+        }catch(\Exception $e){
+            return response()->json(['message' => 'Error when updating role', 'error' => $e->getMessage()], 500);
+        }
     }
 
     /**
@@ -51,6 +76,16 @@ class RolesController extends Controller
      */
     public function destroy(string $id)
     {
-        //
+        try{
+            $role = Role::find($id);
+            if($role){
+                $role->delete();
+                return response()->json(['message' => 'Successfully deleted']);
+            } else {
+                return response()->json(['message' => 'Role not found'], 404);
+            }
+        }catch(\Exception $e){
+            return response()->json(['message' => 'Error when deleting role', 'error' => $e->getMessage()], 500);
+        }
     }
 }

app/Http/Controllers/Api/ScrapingController.php

@@ -4,8 +4,15 @@ namespace App\Http\Controllers\Api;
 
 use App\Enums\ImportDatasourceStatus;
 use App\Http\Controllers\Controller;
+use App\Jobs\ScrapingDataJob;
+use App\Jobs\SyncronizeSIMBG;
 use App\Models\ImportDatasource;
 use App\Traits\GlobalApiResponse;
+use App\Services\ServiceTokenSIMBG;
+use GuzzleHttp\Client;
+use App\Services\ServiceGoogleSheet;
+use App\Services\ServicePbgTask;
+use App\Services\ServiceTabPbgTask;
 use Illuminate\Support\Facades\Artisan;
 use Illuminate\Http\Request;
 
@@ -22,9 +29,12 @@ class ScrapingController extends Controller
             return $this->resError("Failed to execute while processing another scraping");
         }
 
-        // run service artisan command 
+        // use ole schema synchronization
-        Artisan::call("app:execute-scraping");
+        // dispatch(new SyncronizeSIMBG());
-        return $this->resSuccess("Success execute scraping service please wait");
+
+        // use new schema synchronization
+        dispatch(new ScrapingDataJob());
+        return $this->resSuccess(["message" => "Success execute scraping service on background, check status for more"]);
     }
 
     /**

app/Http/Controllers/Api/SpatialPlanningController.php

@@ -0,0 +1,146 @@
+<?php
+
+namespace App\Http\Controllers\Api;
+
+use App\Models\SpatialPlanning;
+use Illuminate\Http\Request;
+use App\Http\Requests\SpatialPlanningRequest;
+use Illuminate\Http\Response;
+use App\Http\Controllers\Controller;
+use App\Http\Resources\SpatialPlanningResource;
+use Illuminate\Support\Facades\DB;
+use Illuminate\Support\Facades\Validator;
+use Maatwebsite\Excel\Facades\Excel;
+use App\Imports\SpatialPlanningImport;
+use Illuminate\Support\Facades\Storage;
+
+class SpatialPlanningController extends Controller
+{
+    /**
+     * Display a listing of the resource.
+     */
+    public function index(Request $request)
+    {
+        info($request);
+        $perPage = $request->input('per_page', 15);
+        $search = $request->input('search', '');
+
+        $query = SpatialPlanning::query();
+        if ($search) {
+            $query->where(function ($q) use ($search) {
+                $q->where('name', 'like', "%$search%")
+                    ->orWhere('kbli', 'like', "%$search%")
+                    ->orWhere('activities', 'like', "%$search%")
+                    ->orWhere('area', 'like', "%$search%")
+                    ->orWhere('location', 'like', "%$search%")
+                    ->orWhere('number', 'like', "%$search%");
+            });
+        }
+                
+        $spatialPlannings = $query->paginate($perPage);
+
+        // Menambhakan nomor urut (No)
+        $start = ($spatialPlannings->currentPage()-1) * $perPage + 1;
+
+        // Tambahkan nomor urut ke dalam data
+        $data = $spatialPlannings->map(function ($item, $index) use ($start) {
+            return array_merge($item->toArray(), ['no' => $start + $index]);
+        });
+
+        info($data);
+
+        return response()->json([
+            'data' => $data,
+            'meta' => [
+                'total' => $spatialPlannings->total(),
+                'per_page' => $spatialPlannings->perPage(),
+                'current_page' => $spatialPlannings->currentPage(),
+                'last_page'=>$spatialPlannings->lastPage(),
+            ]
+        ]);
+    }
+
+    /**
+     * Store a newly created resource in storage.
+     */
+    public function store(SpatialPlanningRequest $request): SpatialPlanning
+    {
+        $data = $request->validated();
+        return SpatialPlanning::create($data);
+    }
+    
+    /**
+     * import spatial planning from excel
+     */
+    public function importFromFile(Request $request)
+    {
+        info($request);
+        //validasi file
+        $validator = Validator::make($request->all(), [
+            'file' => 'required|mimes:xlsx, xls|max:10240'
+        ]);
+
+        if ($validator->fails()) {
+            return response()->json([
+                'message'=>'File vaildation failed.',
+                "errors"=>$validator->errors()
+            ], 400);
+        }
+
+        try {
+            $file = $request->file('file');
+            Excel::import(new SpatialPlanningImport, $file);
+            return response()->json([
+                'message'=>'File uploaded and imported successfully!'
+            ], 200);
+        } catch (\Exception $e) {
+            return response()->json([
+                'message'=>'Error during file import.',
+                'error'=>$e->getMessage()
+            ], 500);
+        }
+    }
+
+    /**
+     * Display the specified resource.
+     */
+    public function show(SpatialPlanning $spatialPlanning): SpatialPlanning
+    {
+        return $spatialPlanning;
+    }
+
+    /**
+     * Update the specified resource in storage.
+     */
+    public function update(SpatialPlanningRequest $request, SpatialPlanning $spatialPlanning): SpatialPlanning
+    {
+        info($request);
+        $data = $request->validated();
+        info($data);
+
+        $spatialPlanning->update($data);
+
+        return $spatialPlanning;
+    }
+
+    public function destroy(SpatialPlanning $spatialPlanning): Response
+    {
+        $spatialPlanning->delete();
+
+        return response()->noContent();
+    }
+
+    public function downloadExcelSpatialPlanning()
+    {
+        $filePath = public_path('templates/template_spatial_planning.xlsx');
+        info(sprintf("File Path: %s | Exists: %s", $filePath, file_exists($filePath) ? 'Yes' : 'No'));
+
+        // Cek apakah file ada
+        if (!file_exists($filePath)) {
+            return response()-> json(['message' => 'File tidak ditemukan!'], Response::HTTP_NOT_FOUND);
+        }
+
+        // Return file to download
+        return response()->download($filePath);
+    }
+}

app/Http/Controllers/Api/TaskAssignmentsController.php

@@ -0,0 +1,64 @@
+<?php
+
+namespace App\Http\Controllers\Api;
+
+use App\Http\Controllers\Controller;
+use App\Http\Resources\TaskAssignmentsResource;
+use App\Models\TaskAssignment;
+use Illuminate\Http\Request;
+
+class TaskAssignmentsController extends Controller
+{
+    /**
+     * Display a listing of the resource.
+     */
+    public function index(Request $request, $uuid)
+    {
+        try{
+            $query = TaskAssignment::query()
+            ->where('pbg_task_uid', $uuid)
+                ->orderBy('id', 'desc');
+
+            if ($request->filled('search')) {
+                $query->where('name', 'like', "%{$request->get('search')}%")
+                ->orWhere('email', 'like', "%{$request->get('search')}%");
+            }
+
+            return TaskAssignmentsResource::collection($query->paginate(config('app.paginate_per_page', 50)));
+        }catch(\Exception $exception){
+            return response()->json(['message' => $exception->getMessage()], 500);
+        }
+    }
+
+    /**
+     * Store a newly created resource in storage.
+     */
+    public function store(Request $request)
+    {
+        //
+    }
+
+    /**
+     * Display the specified resource.
+     */
+    public function show(string $id)
+    {
+        //
+    }
+
+    /**
+     * Update the specified resource in storage.
+     */
+    public function update(Request $request, string $id)
+    {
+        //
+    }
+
+    /**
+     * Remove the specified resource from storage.
+     */
+    public function destroy(string $id)
+    {
+        //
+    }
+}

app/Http/Controllers/Api/TourismController.php

@@ -25,6 +25,13 @@ class TourismController extends Controller
         $search = $request->input('search', '');
 
         $query = Tourism::query();
+        if ($search) {
+            $query->where(function ($q) use ($search) {
+                $q->where('business_name', 'like', "%$search%")
+                    ->orWhere('project_name', 'like', "%$search%")
+                    ->orWhere('business_address', 'like', "%$search%");
+            });
+        }
         $tourisms = $query->paginate($perPage);
 
         $tourisms->getCollection()->transform(function ($tourisms) {
@@ -32,12 +39,18 @@ class TourismController extends Controller
             $tourisms->village_name = $village ? $village->village_name : null;
 
             $district = DB::table('districts')->where('district_code', $tourisms->district_code)->first();
-            $tourisms->district_name = $village ? $village->village_name : null;
+            $tourisms->district_name = $district ? $district->district_name : null;
             return $tourisms;
         });
 
+        $start = ($tourisms->currentPage()-1) * $perPage + 1;
+
+        $data = $tourisms->map(function ($item, $index) use ($start) {
+            return array_merge($item->toArray(), ['no' => $start + $index]);
+        });
+
         return response()->json([
-            'data' => TourismResource::collection($tourisms),
+            'data' => $data,
             'meta' => [
                 'total' => $tourisms->total(),
                 'per_page' => $tourisms->perPage(),
@@ -93,6 +106,18 @@ class TourismController extends Controller
         }
     }
 
+    public function getAllLocation()
+    {
+        $locations = Tourism::whereNotNull('longitude')
+                    ->whereNotNull('latitude')
+                    ->select('project_name', 'longitude', 'latitude')
+                    ->get();
+
+        return response()->json([
+            'data' => $locations
+        ]);
+    }
+
     /**
      * Display the specified resource.
      */
@@ -127,4 +152,18 @@ class TourismController extends Controller
 
         return response()->noContent();
     }
+
+    public function downloadExcelTourism()
+    {
+        $filePath = public_path('templates/template_pariwisata.xlsx');
+        info(sprintf("File Path: %s | Exists: %s", $filePath, file_exists($filePath) ? 'Yes' : 'No'));
+
+        // Cek apakah file ada
+        if (!file_exists($filePath)) {
+            return response()-> json(['message' => 'File tidak ditemukan!'], Response::HTTP_NOT_FOUND);
+        }
+
+        // Return file to download
+        return response()->download($filePath);
+    }
 }

app/Http/Controllers/Api/UmkmController.php

@@ -27,6 +27,17 @@ class UmkmController extends Controller
 
         $query = Umkm::query();
 
+        if ($search) {
+            $query->where(function ($q) use ($search) {
+                $q->where('business_name', 'like', "%$search%")
+                    ->orWhere('business_address', 'like', "%$search%")
+                    ->orWhere('business_desc', 'like', "%$search%")
+                    ->orWhere('business_id_number', 'like', "%$search%")
+                    ->orWhere('owner_id', 'like', "%$search%")
+                    ->orWhere('owner_name', 'like', "%$search%");
+            });
+        }
+
         $umkm = $query->paginate($perPage);
 
         $umkm->getCollection()->transform(function ($umkm) {
@@ -47,8 +58,14 @@ class UmkmController extends Controller
             return $umkm;
         });
 
+        $start = ($umkm->currentPage()-1) * $perPage + 1;
+
+        $data = $umkm->map(function ($item, $index) use ($start) {
+            return array_merge($item->toArray(), ['no' => $start + $index]);
+        });
+
         return response()->json([
-            'data' => UmkmResource::collection($umkm),
+            'data' => $data,
             'meta' => [
                 'total' => $umkm->total(),
                 'per_page' => $umkm->perPage(),
@@ -176,7 +193,7 @@ class UmkmController extends Controller
 
     public function downloadExcelUmkm()
     {
-        $filePath = storage_path('app/public/templates/template_umkm.xlsx');
+        $filePath = public_path('templates/template_umkm.xlsx');
 
         // Cek apakah file ada
         if (!file_exists($filePath)) {

app/Http/Controllers/Api/UsersController.php

@@ -11,6 +11,7 @@ use App\Traits\GlobalApiResponse;
 use Illuminate\Support\Facades\DB;
 use Illuminate\Support\Facades\Hash;
 use Illuminate\Http\Request;
+use Illuminate\Support\Facades\Log;
 
 class UsersController extends Controller
 {
@@ -29,29 +30,30 @@ class UsersController extends Controller
     public function index(Request $request){
         $query = User::query();
         if($request->has('search') && !empty($request->get("search"))){
-            $query->where('name', 'LIKE', '%'.$request->get('search').'%');
+            $query->where('name', 'LIKE', '%'.$request->get('search').'%')
+            ->orWhere('email', 'LIKE', '%'.$request->get('search').'%');
         }
-        return UserResource::collection($query->paginate());
+        return UserResource::collection($query->paginate(config('app.paginate_per_page', 50)));
     }
     public function logout(Request $request){
         $request->user()->tokens()->delete();
         return response()->json(['message' => 'logged out successfully']);
     }
     public function store(UsersRequest $request){
-                $validate_data = $request->validated();
+        $validate_data = $request->validated();
 
         DB::beginTransaction();
         try{
             $user = User::create([
-                'name' => $validate_data->name,
+                'name' => $validate_data['name'],
-                'email' => $validate_data->email,
+                'email' => $validate_data['email'],
-                'password' => Hash::make($validate_data->password),
+                'password' => Hash::make($validate_data['password']),
-                'firstname' => $validate_data->firstname,
+                'firstname' => $validate_data['firstname'],
-                'lastname' => $validate_data->lastname,
+                'lastname' => $validate_data['lastname'],
-                'position' => $validate_data->position
+                'position' => $validate_data['position'],
             ]);
 
-            $user->roles()->attach($request->role_id);
+            $user->roles()->attach((int) $validate_data['role_id']);
 
             DB::commit();
             return response()->json(['message' => 'Successfully created'],201);
@@ -60,4 +62,40 @@ class UsersController extends Controller
             return response()->json(['message' => $e->getMessage()],500);
         };
     }
+    public function update(UsersRequest $request, $id){
+        try{
+            $validate_data = $request->validated();
+            $user = User::findOrFail($id);
+
+            DB::beginTransaction();
+            $user->update([
+                'name' => $validate_data['name'],
+                'email' => $validate_data['email'],
+                'firstname' => $validate_data['firstname'],
+                'lastname' => $validate_data['lastname'],
+                'position' => $validate_data['position']
+            ]);
+
+            $user->roles()->sync($request->role_id);
+
+            DB::commit();
+            return response()->json(['message' => 'Successfully updated'], 200);
+        }catch(\Exception $e){
+            DB::rollBack();
+            return response()->json(['message' => $e->getMessage()],500);
+        }
+    }
+
+    public function destroy($id){
+        try{
+            $user = User::findOrFail($id);
+            DB::beginTransaction();
+            $user->delete(); 
+            DB::commit();
+            return response()->json(['message' => 'Successfully deleted'], 200);
+        }catch(\Exception $e){
+            Log::error('Failed to delete user: '. $e->getMessage());
+            return response()->json(['message' => 'Failed to delete user'],500);
+        }
+    }
 }

app/Http/Controllers/Approval/ApprovalController.php

@@ -0,0 +1,65 @@
+<?php
+
+namespace App\Http\Controllers\Approval;
+
+use App\Http\Controllers\Controller;
+use Illuminate\Http\Request;
+
+class ApprovalController extends Controller
+{
+    /**
+     * Display a listing of the resource.
+     */
+    public function index()
+    {
+        return view('approval.index');
+    }
+
+    /**
+     * Show the form for creating a new resource.
+     */
+    public function create()
+    {
+        //
+    }
+
+    /**
+     * Store a newly created resource in storage.
+     */
+    public function store(Request $request)
+    {
+        //
+    }
+
+    /**
+     * Display the specified resource.
+     */
+    public function show(string $id)
+    {
+        //
+    }
+
+    /**
+     * Show the form for editing the specified resource.
+     */
+    public function edit(string $id)
+    {
+        //
+    }
+
+    /**
+     * Update the specified resource in storage.
+     */
+    public function update(Request $request, string $id)
+    {
+        //
+    }
+
+    /**
+     * Remove the specified resource from storage.
+     */
+    public function destroy(string $id)
+    {
+        //
+    }
+}

app/Http/Controllers/Auth/AuthenticatedSessionController.php

@@ -38,8 +38,6 @@ class AuthenticatedSessionController extends Controller
 
         // Buat token untuk API
         $token = $user->createToken(env('APP_KEY'))->plainTextToken;
-
-        // Simpan token di session (bisa digunakan di JavaScript)
         session(['api_token' => $token]);
 
         return redirect()->intended(RouteServiceProvider::HOME);

app/Http/Controllers/BigdataResumesController.php

@@ -0,0 +1,48 @@
+<?php
+
+namespace App\Http\Controllers;
+
+use Illuminate\Http\Request;
+
+class BigdataResumesController extends Controller
+{
+    /**
+     * Display a listing of the resource.
+     */
+    public function index()
+    {
+        return view('bigdata-resumes.index');
+    }
+
+    /**
+     * Show the form for creating a new resource.
+     */
+    public function create()
+    {
+        //
+    }
+
+    /**
+     * Display the specified resource.
+     */
+    public function show(string $id)
+    {
+        //
+    }
+
+    /**
+     * Show the form for editing the specified resource.
+     */
+    public function edit(string $id)
+    {
+        //
+    }
+
+    /**
+     * Remove the specified resource from storage.
+     */
+    public function destroy(string $id)
+    {
+        //
+    }
+}

app/Http/Controllers/BusinessOrIndustriesController.php

@@ -4,63 +4,40 @@ namespace App\Http\Controllers;
 
 use App\Models\BusinessOrIndustry;
 use Illuminate\Http\Request;
+use Illuminate\Support\Facades\DB;
+use Illuminate\Support\Facades\Auth;
 
 class BusinessOrIndustriesController extends Controller
 {
     /**
      * Display a listing of the resource.
      */
-    public function index()
+    public function index(Request $request)
     {
-        return view('business-industries.index');
+        $menuId = $request->query('menu_id') ?? $request->input('menu_id');
+        $permissions = $this->permissions[$menuId]?? []; // Avoid undefined index error
+        $creator = $permissions['allow_create'] ?? 0;
+        $updater = $permissions['allow_update'] ?? 0;
+        $destroyer = $permissions['allow_destroy'] ?? 0;
+        return view('business-industries.index', compact('creator', 'updater', 'destroyer','menuId'));
     }
-
+    
     /**
      * Show the form for creating a new resource.
      */
-    public function create()
+    public function create(Request $request)
     {
-        return view("business-industries.create");
+        $menuId = $request->query('menu_id') ?? $request->input('menu_id');
-    }
+        return view("business-industries.create", compact('menuId'));
-
-    /**
-     * Store a newly created resource in storage.
-     */
-    public function store(Request $request)
-    {
-        //
-    }
-
-    /**
-     * Display the specified resource.
-     */
-    public function show(string $id)
-    {
-        //
     }
 
     /**
      * Show the form for editing the specified resource.
      */
-    public function edit(string $id)
+    public function edit(string $id, Request $request)
     {
+        $menuId = $request->query('menu_id') ?? $request->input('menu_id');
         $data = BusinessOrIndustry::findOrFail($id);
-        return view('business-industries.edit', compact('data'));
+        return view('business-industries.edit', compact('data', 'menuId'));
-    }
-
-    /**
-     * Update the specified resource in storage.
-     */
-    public function update(Request $request, string $id)
-    {
-        //
-    }
-
-    /**
-     * Remove the specified resource from storage.
-     */
-    public function destroy(string $id)
-    {
-        //
     }
 }

app/Http/Controllers/Chatbot/ChatbotController.php

@@ -0,0 +1,17 @@
+<?php
+
+namespace App\Http\Controllers\Chatbot;
+
+use App\Http\Controllers\Controller;
+use Illuminate\Http\Request;
+
+class ChatbotController extends Controller
+{
+    /**
+     * Displya a listing of the resource
+     */
+    public function index()
+    {
+        return view('chatbot.index');
+    }
+}

app/Http/Controllers/ChatbotPimpinan/ChatbotPimpinanController.php

@@ -0,0 +1,17 @@
+<?php
+
+namespace App\Http\Controllers\ChatbotPimpinan;
+
+use App\Http\Controllers\Controller;
+use Illuminate\Http\Request;
+
+class ChatbotPimpinanController extends Controller
+{
+    /**
+     * Display a listing of the resource
+     */
+    public function index()
+    {
+        return view('chatbot-pimpinan.index');
+    }
+}

app/Http/Controllers/Controller.php

@@ -2,7 +2,54 @@
 
 namespace App\Http\Controllers;
 
+use Illuminate\Support\Facades\Auth;
+
 abstract class Controller
 {
-    //
+    protected array $permissions = [];
+
+    public function __construct()
+    {
+        if (!Auth::check()) {
+            return;
+        }
+        $this->setUserPermissions();
+    }
+
+    protected function setUserPermissions()
+    {
+        $user = Auth::user();
+
+        if (!$user) {
+            return;
+        }
+
+        $menus = $user->roles()
+            ->with(['menus' => function ($query) {
+                $query->select('menus.id', 'menus.name')
+                      ->withPivot(['allow_show' ,'allow_create', 'allow_update', 'allow_destroy']);
+            }])
+            ->get()
+            ->pluck('menus')
+            ->flatten()
+            ->unique('id');
+
+        // Store permissions in an associative array
+        foreach ($menus as $menu) {
+            $this->permissions[$menu->id] = [
+                'allow_show' => $menu->pivot->allow_show ?? 0,
+                'allow_create' => $menu->pivot->allow_create ?? 0,
+                'allow_update' => $menu->pivot->allow_update ?? 0,
+                'allow_destroy' => $menu->pivot->allow_destroy ?? 0,
+            ];
+        }
+
+        // Share permissions globally in views
+        view()->share('permissions', $this->permissions);
+    }
+
+    public function getPermissions()
+    {
+        return $this->permissions;
+    }
 }

app/Http/Controllers/CustomersController.php

@@ -0,0 +1,37 @@
+<?php
+
+namespace App\Http\Controllers;
+
+use App\Models\Customer;
+use Illuminate\Http\Request;
+use Illuminate\Support\Facades\Auth;
+use Illuminate\Support\Facades\DB;
+
+class CustomersController extends Controller
+{
+    public function index(Request $request)
+    {
+        $menuId = $request->query('menu_id') ?? $request->input('menu_id');
+        $permissions = $this->permissions[$menuId]?? []; // Avoid undefined index error
+        $creator = $permissions['allow_create'] ?? 0;
+        $updater = $permissions['allow_update'] ?? 0;
+        $destroyer = $permissions['allow_destroy'] ?? 0;
+
+        return view('customers.index', compact('creator', 'updater', 'destroyer', 'menuId'));
+    }
+    public function create(Request $request)
+    {
+        $menuId = $request->query('menu_id');
+        return view('customers.create', compact('menuId'));
+    }
+    public function edit(Request $request, string $id)
+    {
+        $data = Customer::findOrFail($id);
+        $menuId = $request->query('menu_id');
+        return view('customers.edit', compact('data', 'menuId'));
+    }
+    public function upload(Request $request){
+        $menuId = $request->query('menu_id');
+        return view('customers.upload', compact('menuId'));
+    }
+}

app/Http/Controllers/Dashboards/BigDataController.php

@@ -15,7 +15,8 @@ class BigDataController extends Controller
         return view('dashboards.bigdata', compact('latest_created'));
     }
 
-    public function pbg(){
+    public function pbg()
-        return view('index');
+    {
+        return view('dashboards.pbg');
     }
 }

app/Http/Controllers/Dashboards/PotentialsController.php

@@ -0,0 +1,16 @@
+<?php
+
+namespace App\Http\Controllers\Dashboards;
+
+use App\Http\Controllers\Controller;
+use Illuminate\Http\Request;
+
+class PotentialsController extends Controller
+{
+    public function inside_system(){
+        return view('dashboards.potentials.inside_system');
+    }
+    public function outside_system(){
+        return view('dashboards.potentials.outside_system');
+    }
+}

app/Http/Controllers/Data/AdvertisementController.php

@@ -6,15 +6,23 @@ use App\Http\Controllers\Controller;
 use App\Models\Advertisement;
 use Illuminate\Http\Request;
 use Illuminate\Support\Facades\DB;
+use Illuminate\Support\Facades\Auth;
 
 class AdvertisementController extends Controller
 {
     /**
      * Display a listing of the resource.
      */
-    public function index()
+    public function index(Request $request)
     {
-        return view('data.advertisements.index');
+        $menuId = $request->query('menu_id', 0);
+        $permissions = $this->permissions[$menuId] ?? []; // Avoid undefined index error
+
+        $creator = $permissions['allow_create'] ?? 0;
+        $updater = $permissions['allow_update'] ?? 0;
+        $destroyer = $permissions['allow_destroy'] ?? 0;
+
+        return view('data.advertisements.index', compact('creator', 'updater', 'destroyer','menuId'));
     }
 
     /**
@@ -29,8 +37,9 @@ class AdvertisementController extends Controller
     /**
      * Show the form for creating a new resource.
      */
-    public function create()
+    public function create(Request $request)
     {
+        $menuId = $request->query('menu_id', 0);
         $title = 'Advertisement';
         $subtitle = 'Create Data';
 
@@ -47,14 +56,15 @@ class AdvertisementController extends Controller
         
         // $route = 'advertisements.create';
         // info("AdvertisementController@edit diakses dengan ID: $title");
-        return view('data.advertisements.form', compact('title', 'subtitle', 'fields', 'fieldTypes', 'apiUrl', 'dropdownOptions'));
+        return view('data.advertisements.form', compact('title', 'subtitle', 'fields', 'fieldTypes', 'apiUrl', 'dropdownOptions','menuId'));
     }
 
     /**
      * Show the form for editing the specified resource.
      */
-    public function edit($id)
+    public function edit(Request $request, $id)
     {
+        $menuId = $request->query('menu_id', 0);
         info("AdvertisementController@edit diakses dengan ID: $id");
         $title = 'Advertisement';
         $subtitle = 'Update Data';
@@ -62,7 +72,7 @@ class AdvertisementController extends Controller
         // Pastikan model ditemukan
         if (!$modelInstance) {
             info("AdvertisementController@edit: Model tidak ditemukan.");
-            return redirect()->route('advertisements.index')->with('error', 'Advertisement not found');
+            return redirect()->route('web.advertisements.index')->with('error', 'Advertisement not found');
         }
 
         // Mengambil dan memetakan village_name dan district_name
@@ -86,7 +96,7 @@ class AdvertisementController extends Controller
 
         // $route = 'advertisements.update'; // Menggunakan route update untuk form edit
         // info("AdvertisementController@edit diakses dengan route: $route");
-        return view('data.advertisements.form', compact('title', 'subtitle', 'modelInstance', 'fields', 'fieldTypes', 'apiUrl', 'dropdownOptions'));
+        return view('data.advertisements.form', compact('title', 'subtitle', 'modelInstance', 'fields', 'fieldTypes', 'apiUrl', 'dropdownOptions', 'menuId'));
     }
 
     private function getFields()

app/Http/Controllers/Data/GoogleSheetsController.php

@@ -0,0 +1,36 @@
+<?php
+
+namespace App\Http\Controllers\Data;
+
+use App\Http\Controllers\Controller;
+use App\Models\PbgTaskGoogleSheet;
+use Illuminate\Http\Request;
+
+class GoogleSheetsController extends Controller
+{
+    /**
+     * Display a listing of the resource.
+     */
+    public function index(Request $request)
+    {
+        $menu_id = $request->query('menu_id');
+        $user_menu_permission = $this->permissions[$menu_id];
+        return view('data.google-sheet.index', compact('user_menu_permission'));
+    }
+
+    public function create()
+    {
+        return view('data.google-sheet.create');
+    }
+
+    public function show(string $id)
+    {
+        $data = PbgTaskGoogleSheet::find($id);
+        return view('data.google-sheet.show', compact('data'));
+    }
+
+    public function edit(string $id)
+    {
+        return view('data.google-sheet.edit');
+    }
+}

app/Http/Controllers/Data/SpatialPlanningController.php

@@ -0,0 +1,103 @@
+<?php
+
+namespace App\Http\Controllers\Data;
+
+use App\Http\Controllers\Controller;
+use App\Models\SpatialPlanning;
+use Illuminate\Http\Request;
+
+class SpatialPlanningController extends Controller
+{
+    /**
+     * Display a listing of the resource.
+     */
+    public function index(Request $request)
+    {
+        $menuId = $request->query('menu_id', 0);
+        $permissions = $this->permissions[$menuId] ?? []; // Avoid undefined index error
+
+        $creator = $permissions['allow_create'] ?? 0;
+        $updater = $permissions['allow_update'] ?? 0;
+        $destroyer = $permissions['allow_destroy'] ?? 0;
+
+        return view('data.spatialPlannings.index', compact('creator', 'updater', 'destroyer','menuId'));
+    }
+
+    /**
+     * show the form for creating a new resource.
+     */
+    public function bulkCreate(Request $request)
+    {
+        $menuId = $request->query('menu_id', 0);
+        return view('data.spatialPlannings.form-upload', compact('menuId'));
+    }
+
+    /**
+     * Show the form for creating a new resource.
+     */
+    public function create(Request $request)
+    {
+        $menuId = $request->query('menu_id', 0);
+        $title = 'Rencana Tata Ruang';
+        $subtitle = "Create Data";
+
+        // Mengambil data untuk dropdown
+        $dropdownOptions = [];
+
+        $fields = $this->getFields();
+        $fieldTypes = $this->getFieldTypes();
+
+        $apiUrl = url('/api/spatial-plannings');
+        return view('data.spatialPlannings.form', compact('title', 'subtitle', 'fields', 'fieldTypes', 'apiUrl', 'dropdownOptions','menuId'));
+    }
+
+    /**
+     * Show the form for editing the specified resource.
+     */
+    public function edit(Request $request,string $id)
+    {
+        $menuId = $request->query('menu_id', 0);
+        $title = 'Rencana Tata Ruang';
+        $subtitle = 'Update Data';
+
+        $modelInstance = SpatialPlanning::find($id);
+        // Pastikan model ditemukan
+        if (!$modelInstance) {
+            return redirect()->route('spatialPlanning.index') ->with('error', 'Rencana tata ruang tidak ditemukan');
+        }
+
+        $dropdownOptions = [];
+
+        $fields = $this->getFields();
+        $fieldTypes = $this->getFieldTypes();
+
+        $apiUrl = url('/api/spatial-plannings');
+        return view('data.spatialPlannings.form', compact('title', 'subtitle', 'modelInstance', 'fields', 'fieldTypes', 'apiUrl', 'dropdownOptions','menuId'));
+    }
+
+    private function getFields()
+    {
+        return [
+            "name"=> "Nama",
+            "kbli"=> "KBLI",
+            "activities"=> "Kegiatan",
+            "area"=> "Luas (m2)",
+            "location"=> "Lokasi",
+            "number"=> "Nomor",
+            "date"=> "Tanggal",
+        ];
+    }
+
+    private function getFieldTypes() 
+    {
+        return [
+            "name"=> "text",
+            "kbli"=> "text",
+            "activities"=> "text",
+            "area"=> "text",
+            "location"=> "text",
+            "number"=> "text",
+            "date"=> "date",
+        ];
+    }
+}

app/Http/Controllers/Data/TourismController.php

@@ -6,30 +6,39 @@ use App\Http\Controllers\Controller;
 use App\Models\Tourism;
 use Illuminate\Http\Request;
 use Illuminate\Support\Facades\DB;
+use Illuminate\Support\Facades\Auth;
 
 class TourismController extends Controller
 {
     /**
      * Display a listing of the resource
      */
-    public function index()
+    public function index(Request $request)
     {
-        return view('data.tourisms.index');
+        $menuId = $request->query('menu_id', 0);
+        $permissions = $this->permissions[$menuId] ?? []; // Avoid undefined index error
+
+        $creator = $permissions['allow_create'] ?? 0;
+        $updater = $permissions['allow_update'] ?? 0;
+        $destroyer = $permissions['allow_destroy'] ?? 0;
+        return view('data.tourisms.index', compact('creator', 'updater', 'destroyer', 'menuId'));
     }
 
     /**
      * show the form for creating a new rsource.
      */
-    public function bulkCreate()
+    public function bulkCreate(Request $request)
     {
-        return view('data.tourisms.form-upload');
+        $menuId = $request->query('menu_id', 0);
+        return view('data.tourisms.form-upload', compact('menuId'));
     }
 
     /**
      * Show th form for creating a new resource
      */
-    public function create()
+    public function create(Request $request)
     {
+        $menuId = $request->query('menu_id', 0);
         $title = 'Pariwisata';
         $subtitle = 'Create Data';
 
@@ -44,21 +53,22 @@ class TourismController extends Controller
 
         $apiUrl = url('/api/tourisms');
 
-        return view('data.tourisms.form', compact('title', 'subtitle', 'fields', 'fieldTypes', 'apiUrl', 'dropdownOptions'));
+        return view('data.tourisms.form', compact('title', 'subtitle', 'fields', 'fieldTypes', 'apiUrl', 'dropdownOptions', 'menuId'));
     }
 
     /**
      * show the form for editing the specified resource.
      */
-    public function edit($id)
+    public function edit(Request $request, $id)
     {
+        $menuId = $request->query('menu_id', 0);
         $title = 'Pariwisata';
-        $subtitle = 'Create Data';
+        $subtitle = 'Update Data';
 
         $modelInstance = Tourism::find($id);
         // Pastikan model ditemukan
         if (!$modelInstance) {
-            return redirect()->route('tourisms.index') ->with('error', 'Pariwisata tidak ditemukan');
+            return redirect()->route('web-tourisms.index') ->with('error', 'Pariwisata tidak ditemukan');
         }
 
         // Mengambil dan memetakan village_name dan district_name
@@ -78,7 +88,7 @@ class TourismController extends Controller
 
         $apiUrl = url('/api/tourisms');
 
-        return view('data.tourisms.form', compact('title', 'subtitle', 'modelInstance', 'fields', 'fieldTypes', 'apiUrl', 'dropdownOptions'));
+        return view('data.tourisms.form', compact('title', 'subtitle', 'modelInstance', 'fields', 'fieldTypes', 'apiUrl', 'dropdownOptions', 'menuId'));
     }
 
     private function getFields()

app/Http/Controllers/Data/UmkmController.php

@@ -6,30 +6,39 @@ use App\Http\Controllers\Controller;
 use App\Models\Umkm;
 use Illuminate\Http\Request;
 use Illuminate\Support\Facades\DB;
+use Illuminate\Support\Facades\Auth;
 
 class UmkmController extends Controller
 {
     /**
      * Display a listing of the resource.
      */
-    public function index()
+    public function index(Request $request)
     {
-        return view('data.umkm.index');
+        $menuId = $request->query('menu_id', 0);
+        $permissions = $this->permissions[$menuId] ?? []; // Avoid undefined index error
+
+        $creator = $permissions['allow_create'] ?? 0;
+        $updater = $permissions['allow_update'] ?? 0;
+        $destroyer = $permissions['allow_destroy'] ?? 0;
+        return view('data.umkm.index', compact('creator', 'updater', 'destroyer', 'menuId'));
     }
 
     /**
      * Show the form for creating a new resource.
      */
-    public function bulkCreate()
+    public function bulkCreate(Request $request)
     {
-        return view('data.umkm.form-upload');
+        $menuId = $request->query('menu_id', 0);
+        return view('data.umkm.form-upload', compact('menuId'));
     }
 
     /**
      * Show the form for creating a new resource.
      */
-    public function create()
+    public function create(Request $request)
     {
+        $menuId = $request->query('menu_id', 0);
         $title = 'UMKM';
         $subtitle = 'Create Data';
 
@@ -47,20 +56,21 @@ class UmkmController extends Controller
 
         $apiUrl = url('/api/umkm');
 
-        return view('data.umkm.form', compact('title', 'subtitle', 'fields', 'fieldTypes', 'apiUrl', 'dropdownOptions'));
+        return view('data.umkm.form', compact('title', 'subtitle', 'fields', 'fieldTypes', 'apiUrl', 'dropdownOptions','menuId'));
     }
 
     /**
      * Show the form for editing the specified resource.
      */
-    public function edit($id)
+    public function edit(Request $request,$id)
     {
+        $menuId = $request->query('menu_id', 0);
         $title = 'UMKM';
         $subtitle = 'Update Data';
         $modelInstance = Umkm::find($id);
         // Pastikan model ditemukan
         if (!$modelInstance) {
-            return redirect()->route('umkm.index')->with('error', 'Umkm not found');
+            return redirect()->route('web-umkm.index')->with('error', 'Umkm not found');
         }
 
         // Mengambil dan memetakan village_name dan district_name
@@ -96,7 +106,7 @@ class UmkmController extends Controller
         $apiUrl = url('/api/umkm');
 
         // dd($modelInstance->business_form_id, $dropdownOptions['business_form']);
-        return view('data.umkm.form', compact('title', 'subtitle', 'modelInstance', 'fields', 'fieldTypes', 'apiUrl', 'dropdownOptions'));
+        return view('data.umkm.form', compact('title', 'subtitle', 'modelInstance', 'fields', 'fieldTypes', 'apiUrl', 'dropdownOptions','menuId'));
     }
 
     private function getFields()

app/Http/Controllers/DataSettingController.php

@@ -8,23 +8,31 @@ use Exception;
 use Illuminate\Support\Facades\DB;
 use Illuminate\Support\Facades\Log;
 use Illuminate\Support\Facades\Request;
+use Illuminate\Support\Facades\Auth;
+use Illuminate\Http\Request as IndexRequest;
 
 class DataSettingController extends Controller
 {
     /**
      * Display a listing of the resource.
      */
-    public function index()
+    public function index(IndexRequest $request)
     {
-        return view("data-settings.index");
+        $menuId = $request->query('menu_id') ?? $request->input('menu_id');
+        $permissions = $this->permissions[$menuId]?? []; // Avoid undefined index error
+        $creator = $permissions['allow_create'] ?? 0;
+        $updater = $permissions['allow_update'] ?? 0;
+        $destroyer = $permissions['allow_destroy'] ?? 0;
+        return view("data-settings.index", compact('creator', 'updater', 'destroyer','menuId'));
     }
 
     /**
      * Show the form for creating a new resource.
      */
-    public function create()
+    public function create(IndexRequest $request)
     {
-        return view("data-settings.create");
+        $menuId = $request->query('menu_id') ?? $request->input('menu_id');
+        return view("data-settings.create", compact('menuId'));
     }
 
     /**
@@ -57,14 +65,15 @@ class DataSettingController extends Controller
     /**
      * Show the form for editing the specified resource.
      */
-    public function edit(string $id)
+    public function edit(IndexRequest $request,string $id)
     {
         try{
             $data = DataSetting::findOrFail($id);
+            $menuId = $request->query('menu_id') ?? $request->input('menu_id');
             if(empty($data)){
                 return redirect()->route('data-settings.index')->with('error', 'Invalid id');
             }
-            return view("data-settings.edit", compact("data"));
+            return view("data-settings.edit", compact("data", 'menuId'));
         }catch(Exception $ex){
             return redirect()->route("data-settings.index")->with("error", "Invalid id");
         }

app/Http/Controllers/GoogleApisController.php

@@ -0,0 +1,12 @@
+<?php
+
+namespace App\Http\Controllers;
+
+use Illuminate\Http\Request;
+
+class GoogleApisController extends Controller
+{
+    public function index(){
+        return view('maps.google-api');
+    }
+}

app/Http/Controllers/InvitationsController.php

@@ -0,0 +1,12 @@
+<?php
+
+namespace App\Http\Controllers;
+
+use Illuminate\Http\Request;
+
+class InvitationsController extends Controller
+{
+    public function index(Request $request){
+        return view('invitations.index');
+    }
+}

app/Http/Controllers/Master/UsersController.php

@@ -13,6 +13,7 @@ use Illuminate\Support\Facades\Hash;
 use App\Models\User;
 use App\Traits\GlobalApiResponse;
 use Illuminate\Auth\Events\Registered;
+use Illuminate\Support\Facades\Auth;
 
 class UsersController extends Controller
 {
@@ -21,13 +22,20 @@ class UsersController extends Controller
         $users = User::all();
         return $this->resSuccess($users);
     }
-    public function index(){
+    public function index(Request $request){
+        $menuId = $request->query('menu_id') ?? $request->input('menu_id');
+        $permissions = $this->permissions[$menuId]?? []; // Avoid undefined index error
+        $creator = $permissions['allow_create'] ?? 0;
+        $updater = $permissions['allow_update'] ?? 0;
+        $destroyer = $permissions['allow_destroy'] ?? 0;
+
         $users = User::paginate();
-        return view('master.users.index', compact('users'));
+        return view('master.users.index', compact('users', 'creator', 'updater', 'destroyer','menuId'));
     }
-    public function create(){
+    public function create(Request $request){
+        $menuId = $request->query('menu_id') ?? $request->input('menu_id');
         $roles = Role::all();
-        return view('master.users.create', compact('roles'));
+        return view('master.users.create', compact('roles', 'menuId'));
     }
     public function store(UsersRequest $request){
         $request->validate([
@@ -65,10 +73,11 @@ class UsersController extends Controller
         $user = User::find($id);
         return view('master.users.show', compact('user'));
     }
-    public function edit($id){
+    public function edit(Request $request, $id){
+        $menuId = $request->query('menu_id') ?? $request->input('menu_id');
         $user = User::find($id);
         $roles = Role::all();
-        return view('master.users.edit', compact('user', 'roles'));
+        return view('master.users.edit', compact('user', 'roles', 'menuId'));
     }
     public function update(Request $request, $id){
         $user = User::find($id);

app/Http/Controllers/MenusController.php

@@ -12,18 +12,35 @@ class MenusController extends Controller
     /**
      * Display a listing of the resource.
      */
-    public function index()
+    public function index(Request $request)
     {
-        return view('menus.index');
+        $menuId = (int) $request->query('menu_id', 0);
+        $permissions = $this->permissions[$menuId] ?? []; // Avoid undefined index error
+
+        $creator = $permissions['allow_create'] ?? 0;
+        $updater = $permissions['allow_update'] ?? 0;
+        $destroyer = $permissions['allow_destroy'] ?? 0;
+
+        return view('menus.index', compact('creator', 'updater', 'destroyer', 'menuId'));
     }
 
     /**
      * Show the form for creating a new resource.
      */
-    public function create()
+    public function create(Request $request)
     {
-        $parent_menus = Menu::whereNull('parent_id')->get();
+        $menuId = $request->query('menu_id'); // Get menu_id from request
-        return view("menus.create", compact('parent_menus'));
+        $menu = Menu::with('children')->find($menuId); // Find the menu
+
+        // Get IDs of all child menus to exclude
+        $excludedIds = $menu ? $this->getChildMenuIds($menu) : [$menuId];
+
+        // Fetch only menus that have children and are not in the excluded list
+        $parent_menus = Menu::whereHas('children')
+            ->whereNotIn('id', $excludedIds)
+            ->get();
+
+        return view("menus.create", compact('parent_menus', 'menuId'));
     }
 
     /**
@@ -56,11 +73,16 @@ class MenusController extends Controller
     /**
      * Show the form for editing the specified resource.
      */
-    public function edit(string $id)
+    public function edit(string $id, Request $request)
     {
-        $menu = Menu::findOrFail($id);
+        $menuId = $request->query('menu_id');
-        $parent_menus = Menu::whereNull('parent_id')->where('id','!=',$id)->get();
+        $menu = Menu::with('children')->find($id);
-        return view("menus.edit", compact('menu','parent_menus'));
+        $excludedIds = $menu ? $this->getChildMenuIds($menu) : [$id]; 
+
+        $parent_menus = Menu::whereHas('children')
+            ->whereNotIn('id', $excludedIds)
+            ->get();
+        return view("menus.edit", compact('menu','parent_menus', 'menuId'));
     }
 
     /**
@@ -110,4 +132,15 @@ class MenusController extends Controller
             $child->delete();
         }
     }
+
+    private function getChildMenuIds($menu)
+    {
+        $ids = [$menu->id]; // Start with current menu ID
+
+        foreach ($menu->children as $child) {
+            $ids = array_merge($ids, $this->getChildMenuIds($child)); // Recursively fetch children
+        }
+
+        return $ids;
+    }
 }

app/Http/Controllers/PaymentRecapsController.php

@@ -0,0 +1,64 @@
+<?php
+
+namespace App\Http\Controllers;
+
+use Illuminate\Http\Request;
+
+class PaymentRecapsController extends Controller
+{
+    /**
+     * Display a listing of the resource.
+     */
+    public function index()
+    {
+        return view('payment-recaps.index');
+    }
+
+    /**
+     * Show the form for creating a new resource.
+     */
+    public function create()
+    {
+        //
+    }
+
+    /**
+     * Store a newly created resource in storage.
+     */
+    public function store(Request $request)
+    {
+        //
+    }
+
+    /**
+     * Display the specified resource.
+     */
+    public function show(string $id)
+    {
+        //
+    }
+
+    /**
+     * Show the form for editing the specified resource.
+     */
+    public function edit(string $id)
+    {
+        //
+    }
+
+    /**
+     * Update the specified resource in storage.
+     */
+    public function update(Request $request, string $id)
+    {
+        //
+    }
+
+    /**
+     * Remove the specified resource from storage.
+     */
+    public function destroy(string $id)
+    {
+        //
+    }
+}

app/Http/Controllers/Report/ReportTourismController.php

@@ -15,7 +15,6 @@ class ReportTourismController extends Controller
     public function index()
     {
         $tourismBasedKBLI = TourismBasedKBLI::all();
-        info($tourismBasedKBLI);
         return view('report.tourisms.index', compact('tourismBasedKBLI'));
     }
 }

app/Http/Controllers/ReportPaymentRecapsController.php

@@ -0,0 +1,12 @@
+<?php
+
+namespace App\Http\Controllers;
+
+use Illuminate\Http\Request;
+
+class ReportPaymentRecapsController extends Controller
+{
+    public function index(Request $request){
+        return view('report-payment-recaps.index');
+    }
+}

app/Http/Controllers/ReportPbgPTSPController.php

@@ -0,0 +1,12 @@
+<?php
+
+namespace App\Http\Controllers;
+
+use Illuminate\Http\Request;
+
+class ReportPbgPTSPController extends Controller
+{
+    public function index(Request $request){
+        return view('report-pbg-ptsp.index');
+    }
+}

app/Http/Controllers/RequestAssignment/PbgTaskController.php

@@ -5,15 +5,37 @@ namespace App\Http\Controllers\RequestAssignment;
 use App\Http\Controllers\Controller;
 use App\Models\PbgTask;
 use Illuminate\Http\Request;
+use Illuminate\Support\Facades\DB;
+use Illuminate\Support\Facades\Auth;
 
 class PbgTaskController extends Controller
 {
     /**
      * Display a listing of the resource.
      */
-    public function index()
+    public function index(Request $request)
     {
-        return view('pbg_task.index');
+        $menuId = $request->query('menu_id');
+        $user = Auth::user();
+        $userId = $user->id;
+
+        // Ambil role_id yang dimiliki user
+        $roleIds = DB::table('user_role')
+            ->where('user_id', $userId)
+            ->pluck('role_id');
+
+        // Ambil data akses berdasarkan role_id dan menu_id
+        $roleAccess = DB::table('role_menu')
+            ->whereIn('role_id', $roleIds)
+            ->where('menu_id', $menuId)
+            ->first();
+
+        // Pastikan roleAccess tidak null sebelum mengakses properti
+        $creator = $roleAccess->allow_create ?? 0;
+        $updater = $roleAccess->allow_update ?? 0;
+        $destroyer = $roleAccess->allow_destroy ?? 0;
+
+        return view('pbg_task.index', compact('creator', 'updater', 'destroyer'));
     }
 
     /**

app/Http/Controllers/RolesController.php

@@ -10,23 +10,31 @@ use Illuminate\Http\Request;
 use Illuminate\Support\Facades\DB;
 use Illuminate\Support\Facades\Log;
 use Illuminate\Support\Facades\Schema;
+use Illuminate\Support\Facades\Auth;
 
 class RolesController extends Controller
 {
     /**
      * Display a listing of the resource.
      */
-    public function index()
+    public function index(Request $request)
     {
-        return view("roles.index");
+        $menuId = $request->query('menu_id') ?? $request->input('menu_id');
+        $permissions = $this->permissions[$menuId]?? []; // Avoid undefined index error
+        $creator = $permissions['allow_create'] ?? 0;
+        $updater = $permissions['allow_update'] ?? 0;
+        $destroyer = $permissions['allow_destroy'] ?? 0;
+
+        return view("roles.index", compact('creator', 'updater', 'destroyer', 'menuId'));
     }
 
     /**
      * Show the form for creating a new resource.
      */
-    public function create()
+    public function create(Request $request)
     {
-        return view("roles.create");
+        $menuId = $request->query('menu_id');
+        return view("roles.create", compact('menuId'));
     }
 
     /**
@@ -59,10 +67,11 @@ class RolesController extends Controller
     /**
      * Show the form for editing the specified resource.
      */
-    public function edit(string $id)
+    public function edit(string $id, Request $request)
     {
+        $menuId = $request->query('menu_id');
         $role = Role::findOrFail($id);
-        return view("roles.edit", compact('role'));
+        return view("roles.edit", compact('role', 'menuId'));
     }
 
     /**
@@ -100,12 +109,13 @@ class RolesController extends Controller
         }
     }
 
-    public function menu_permission(string $role_id){
+    public function menu_permission(string $role_id, Request $request){
         try{
+            $menuId = $request->query('menu_id');
             $role = Role::findOrFail($role_id);
             $menus = Menu::all();
             $role_menus = RoleMenu::where('role_id', $role_id)->get() ?? collect();
-            return view('roles.role_menu', compact('role', 'menus', 'role_menus'));
+            return view('roles.role_menu', compact('role', 'menus', 'role_menus', 'menuId'));
         }catch(\Exception $e){
             return redirect()->back()->with("error", $e->getMessage());
         }
@@ -113,8 +123,9 @@ class RolesController extends Controller
 
     public function update_menu_permission(Request $request, string $role_id){
         try{
+            $menuId = $request->query('menu_id');
             $validateData = $request->validate([
-                "permissions" => "array",
+                "permissions" => "nullable|array",
                 "permissions.*.allow_show" => "nullable|boolean",
                 "permissions.*.allow_create" => "nullable|boolean",
                 "permissions.*.allow_update" => "nullable|boolean",
@@ -123,6 +134,13 @@ class RolesController extends Controller
 
             $role = Role::find($role_id);
 
+            // Jika `permissions` tidak ada atau kosong, hapus semua permissions terkait
+            if (!isset($validateData['permissions']) || empty($validateData['permissions'])) {
+                $role->menus()->detach();
+                return redirect()->route("roles.index", ['menu_id' => $menuId])
+                    ->with('success', 'All menu permissions have been removed.');
+            }
+
             $permissionsArray = [];
             foreach ($validateData['permissions'] as $menu_id => $permission) {
                 $permissionsArray[$menu_id] = [
@@ -137,7 +155,7 @@ class RolesController extends Controller
             // Sync will update existing records and insert new ones
             $role->menus()->sync($permissionsArray);
 
-            return redirect()->route("role-menu.permission", $role_id)->with('success','Menu Permission updated successfully');
+            return redirect()->route("roles.index", ['menu_id' => $menuId])->with('success','Menu Permission updated successfully');
         }catch(\Exception $e){
             Log::error("Error updating role_menu:", ["error" => $e->getMessage()]);
             return redirect()->route("role-menu.permission", $role_id)->with("error", $e->getMessage());

app/Http/Controllers/Settings/SyncronizeController.php

@@ -6,6 +6,8 @@ use App\Http\Controllers\Controller;
 use App\Services\ServiceSIMBG;
 use Illuminate\Http\Request;
 use Exception;
+use Illuminate\Support\Facades\Auth;
+use Illuminate\Support\Facades\DB;
 class SyncronizeController extends Controller
 {
     protected $service_simbg;
@@ -13,16 +15,36 @@ class SyncronizeController extends Controller
         $this->service_simbg = $service_simbg;
     }
     public function index(Request $request){
-        return view('settings.syncronize.index');
+        $menuId = $request->query('menu_id');
+        $user = Auth::user();
+        $userId = $user->id;
+
+        // Ambil role_id yang dimiliki user
+        $roleIds = DB::table('user_role')
+            ->where('user_id', $userId)
+            ->pluck('role_id');
+
+        // Ambil data akses berdasarkan role_id dan menu_id
+        $roleAccess = DB::table('role_menu')
+            ->whereIn('role_id', $roleIds)
+            ->where('menu_id', $menuId)
+            ->first();
+
+        // Pastikan roleAccess tidak null sebelum mengakses properti
+        $creator = $roleAccess->allow_create ?? 0;
+        $updater = $roleAccess->allow_update ?? 0;
+        $destroyer = $roleAccess->allow_destroy ?? 0;
+
+        return view('settings.syncronize.index', compact('creator', 'updater', 'destroyer'));
     }
 
     public function syncPbgTask(){
-        $res = $this->service_simbg->syncTaskList();
+        $res = $this->service_simbg->syncTaskPBG();
         return $res;
     }
 
     public function syncronizeTask(Request $request){
-        $res = $this->service_simbg->syncTaskList();
+        $res = $this->service_simbg->syncTaskPBG();
         return redirect()->back()->with('success', 'Processing completed successfully');
     }
 
@@ -33,7 +55,7 @@ class SyncronizeController extends Controller
 
     public function syncIndexIntegration(Request $request, $uuid){
         $token = $request->get('token');
-        $res = $this->service_simbg->syncIndexIntegration($uuid, $token);
+        $res = $this->service_simbg->syncIndexIntegration($uuid);
         return $res;
     }
 
@@ -42,4 +64,9 @@ class SyncronizeController extends Controller
         $res = $this->service_simbg->syncTaskDetailSubmit($uuid, $token);
         return $res;
     }
+
+    public function syncTaskAssignments($uuid){
+        $res = $this->service_simbg->syncTaskAssignments($uuid);
+        return $res;
+    }
 }

app/Http/Controllers/TpatptsController.php

@@ -0,0 +1,28 @@
+<?php
+
+namespace App\Http\Controllers;
+
+use Illuminate\Http\Request;
+
+class TpatptsController extends Controller
+{
+    public function index()
+    {
+        return view('tpa-tpt.index');
+    }
+
+    public function create()
+    {
+        //
+    }
+
+    public function show(string $id)
+    {
+        //
+    }
+
+    public function edit(string $id)
+    {
+        //
+    }
+}

app/Http/Requests/AdvertisementRequest.php

@@ -40,4 +40,40 @@ class AdvertisementRequest extends FormRequest
 			'contact' => 'required|string',
         ];
     }
+
+    /**
+     * pesan error validasi
+     */
+    public function messages(): array
+    {
+        return [
+            'no.required' => 'Nomor harus diisi.',
+            'business_name.required' => 'Nama usaha harus diisi.',
+            'business_name.string' => 'Nama usaha harus berupa teks.',
+            'npwpd.required' => 'NPWPD harus diisi.',
+            'npwpd.string' => 'NPWPD harus berupa teks.',
+            'advertisement_type.required' => 'Jenis reklame harus diisi.',
+            'advertisement_type.string' => 'Jenis reklame harus berupa teks.',
+            'advertisement_content.required' => 'Isi reklame harus diisi.',
+            'advertisement_content.string' => 'Isi reklame harus berupa teks.',
+            'business_address.required' => 'Alamat usaha harus diisi.',
+            'business_address.string' => 'Alamat usaha harus berupa teks.',
+            'advertisement_location.required' => 'Lokasi reklame harus diisi.',
+            'advertisement_location.string' => 'Lokasi reklame harus berupa teks.',
+            'village_name.required' => 'Nama desa harus diisi.',
+            'district_name.required' => 'Nama kecamatan harus diisi.',
+            'length.required' => 'Panjang harus diisi.',
+            'width.required' => 'Lebar harus diisi.',
+            'viewing_angle.required' => 'Sudut pandang harus diisi.',
+            'viewing_angle.string' => 'Sudut pandang harus berupa teks.',
+            'face.required' => 'Jumlah sisi harus diisi.',
+            'face.string' => 'Jumlah sisi harus berupa teks.',
+            'area.required' => 'Luas harus diisi.',
+            'area.string' => 'Luas harus berupa teks.',
+            'angle.required' => 'Sudut harus diisi.',
+            'angle.string' => 'Sudut harus berupa teks.',
+            'contact.required' => 'Kontak harus diisi.',
+            'contact.string' => 'Kontak harus berupa teks.',
+        ];
+    }
 }

app/Http/Requests/CustomersRequest.php

@@ -0,0 +1,33 @@
+<?php
+
+namespace App\Http\Requests;
+
+use Illuminate\Foundation\Http\FormRequest;
+
+class CustomersRequest extends FormRequest
+{
+    /**
+     * Determine if the user is authorized to make this request.
+     */
+    public function authorize(): bool
+    {
+        return true;
+    }
+
+    /**
+     * Get the validation rules that apply to the request.
+     *
+     * @return array<string, \Illuminate\Contracts\Validation\ValidationRule|array<mixed>|string>
+     */
+    public function rules(): array
+    {
+        return [
+            'nomor_pelanggan' => ['required', 'string'],
+            'kota_pelayanan' => ['required', 'string'],
+            'nama' => ['required', 'string'],
+            'alamat' => ['required', 'string'],
+            'latitude' => ['required', 'numeric', 'between:-90,90'],
+            'longitude' => ['required', 'numeric', 'between:-180,180'],
+        ];
+    }
+}

app/Http/Requests/DataSettingRequest.php

@@ -21,7 +21,7 @@ class DataSettingRequest extends FormRequest
      */
     public function rules(): array
     {
-        $id = $this->route('data_setting');
+        $id = $this->route('data_setting_id');
         return [
             "key" => "required|unique:data_settings,key," . $id,
             "value" => "required",

app/Http/Requests/ExcelUploadRequest.php

@@ -0,0 +1,28 @@
+<?php
+
+namespace App\Http\Requests;
+
+use Illuminate\Foundation\Http\FormRequest;
+
+class ExcelUploadRequest extends FormRequest
+{
+    /**
+     * Determine if the user is authorized to make this request.
+     */
+    public function authorize(): bool
+    {
+        return true;
+    }
+
+    /**
+     * Get the validation rules that apply to the request.
+     *
+     * @return array<string, \Illuminate\Contracts\Validation\ValidationRule|array<mixed>|string>
+     */
+    public function rules(): array
+    {
+        return [
+            "file" => "required|file|mimes:xlsx,xls|max:102400"
+        ];
+    }
+}

app/Http/Requests/MenuRequest.php

@@ -3,6 +3,7 @@
 namespace App\Http\Requests;
 
 use Illuminate\Foundation\Http\FormRequest;
+use Illuminate\Validation\Rule;
 
 class MenuRequest extends FormRequest
 {
@@ -21,12 +22,14 @@ class MenuRequest extends FormRequest
      */
     public function rules(): array
     {
+        $menuId = $this->route('menu_id'); // Get the menu ID if updating
+
         return [
-            'name' => ['required','string','max:255'],
+            'name' => ['required', 'string', 'max:255', Rule::unique('menus', 'name')->ignore($menuId)],
-            'url' => ['nullable','string','max:255'],
+            'url' => ['nullable', 'string', 'max:255'],
-            'icon' => ['nullable','string','max:255'],
+            'icon' => ['nullable', 'string', 'max:255'],
-            'parent_id' => ['nullable','exists:menus,id'],
+            'parent_id' => ['nullable', 'exists:menus,id'],
-            'sort_order' => ['required','integer'],
+            'sort_order' => ['required', 'integer'],
         ];
     }
 }

app/Http/Requests/RoleRequest.php

@@ -21,7 +21,7 @@ class RoleRequest extends FormRequest
      */
     public function rules(): array
     {
-        $roleId = $this->route('role');
+        $roleId = $this->route('role_id');
         return [
             'name' => 'required|string|max:255|unique:roles,name,' . ($roleId ?? 'NULL') . ',id',
             'description' => 'nullable|string',

app/Http/Requests/SpatialPlanningRequest.php

@@ -0,0 +1,52 @@
+<?php
+
+namespace App\Http\Requests;
+
+use Illuminate\Foundation\Http\FormRequest;
+
+class SpatialPlanningRequest extends FormRequest
+{
+    /**
+     * Determine if the user is authorized to make this request.
+     */
+    public function authorize(): bool
+    {
+        return true;
+    }
+
+    /**
+     * Get the validation rules that apply to the request.
+     *
+     * @return array<string, \Illuminate\Contracts\Validation\ValidationRule|array<mixed>|string>
+     */
+    public function rules(): array
+    {
+        return [
+			'name' => 'string',
+			'kbli' => 'string',
+			'activities' => 'string',
+			'area' => 'string',
+			'location' => 'string',
+			'number' => 'string',
+            'date' => 'date_format:Y-m-d',
+        ];
+    }
+
+    /**
+     * Get the validation messages for the defined validation rules.
+     *
+     * @return array<string, string>
+     */
+    public function messages(): array
+    {
+        return [
+            'name.string' => 'Kolom Nama harus berupa teks.',
+            'kbli.string' => 'Kolom KBLI harus berupa teks.',
+            'activities.string' => 'Kolom Kegiatan harus berupa teks.',
+            'area.string' => 'Kolom Area harus berupa teks.',
+            'location.string' => 'Kolom Lokasi harus berupa teks.',
+            'number.string' => 'Kolom Nomor harus berupa teks.',
+            'date.date_format' => 'Format tanggal tidak valid, gunakan format Y-m-d H:i:s.',
+        ];
+    }
+}

app/Http/Requests/SpatialPlanningsRequest.php

@@ -0,0 +1,35 @@
+<?php
+
+namespace App\Http\Requests;
+
+use Illuminate\Foundation\Http\FormRequest;
+use Illuminate\Validation\Rule;
+
+class SpatialPlanningsRequest extends FormRequest
+{
+    /**
+     * Determine if the user is authorized to make this request.
+     */
+    public function authorize(): bool
+    {
+        return true;
+    }
+
+    /**
+     * Get the validation rules that apply to the request.
+     *
+     * @return array<string, \Illuminate\Contracts\Validation\ValidationRule|array<mixed>|string>
+     */
+    public function rules(): array
+    {
+        return [
+            'name' => ['required','string','max:255'],
+            'kbli' => ['required','string','max:255'],
+            'kegiatan' => ['required','string'],
+            'luas' => ['required','numeric','regex:/^\d{1,16}(\.\d{1,2})?$/'],
+            'lokasi' => ['required','string'],
+            'nomor' => ['required','string','max:255',Rule::unique('spatial_plannings')->ignore($this->id)],
+            'sp_date' => ['required','date'],
+        ];
+    }
+}

app/Http/Requests/TourismRequest.php

@@ -49,4 +49,85 @@ class TourismRequest extends FormRequest
 			'tki' => 'required|string',
         ];
     }
+
+	/**
+	 * Get the validation messages for the defined validation rules.
+	 *
+	 * @return array<string, string>
+	 */
+	public function messages(): array
+	{
+		return [
+			'project_id.required' => 'ID proyek harus diisi.',
+			'project_id.string' => 'ID proyek harus berupa teks.',
+
+			'project_type_id.required' => 'ID tipe proyek harus diisi.',
+			'project_type_id.string' => 'ID tipe proyek harus berupa teks.',
+
+			'nib.required' => 'NIB harus diisi.',
+			'nib.string' => 'NIB harus berupa teks.',
+
+			'business_name.required' => 'Nama usaha harus diisi.',
+			'business_name.string' => 'Nama usaha harus berupa teks.',
+
+			'oss_publication_date.required' => 'Tanggal publikasi OSS harus diisi.',
+
+			'investment_status_description.required' => 'Deskripsi status investasi harus diisi.',
+			'investment_status_description.string' => 'Deskripsi status investasi harus berupa teks.',
+
+			'business_form.required' => 'Bentuk usaha harus diisi.',
+			'business_form.string' => 'Bentuk usaha harus berupa teks.',
+
+			'project_risk.required' => 'Risiko proyek harus diisi.',
+			'project_risk.string' => 'Risiko proyek harus berupa teks.',
+
+			'project_name.required' => 'Nama proyek harus diisi.',
+			'project_name.string' => 'Nama proyek harus berupa teks.',
+
+			'business_scale.required' => 'Skala usaha harus diisi.',
+			'business_scale.string' => 'Skala usaha harus berupa teks.',
+
+			'business_address.required' => 'Alamat usaha harus diisi.',
+			'business_address.string' => 'Alamat usaha harus berupa teks.',
+
+			'district_name.required' => 'Nama kecamatan harus diisi.',
+
+			'village_name.required' => 'Nama desa harus diisi.',
+
+			'longitude.required' => 'Garis bujur harus diisi.',
+			'longitude.string' => 'Garis bujur harus berupa teks.',
+
+			'latitude.required' => 'Garis lintang harus diisi.',
+			'latitude.string' => 'Garis lintang harus berupa teks.',
+
+			'project_submission_date.required' => 'Tanggal pengajuan proyek harus diisi.',
+
+			'kbli.required' => 'Kode KBLI harus diisi.',
+			'kbli.string' => 'Kode KBLI harus berupa teks.',
+
+			'kbli_title.required' => 'Judul KBLI harus diisi.',
+			'kbli_title.string' => 'Judul KBLI harus berupa teks.',
+
+			'supervisory_sector.required' => 'Sektor pengawasan harus diisi.',
+			'supervisory_sector.string' => 'Sektor pengawasan harus berupa teks.',
+
+			'user_name.required' => 'Nama pengguna harus diisi.',
+			'user_name.string' => 'Nama pengguna harus berupa teks.',
+
+			'email.required' => 'Email harus diisi.',
+			'email.string' => 'Email harus berupa teks.',
+
+			'contact.required' => 'Kontak harus diisi.',
+			'contact.string' => 'Kontak harus berupa teks.',
+
+			'land_area_in_m2.required' => 'Luas lahan dalam m² harus diisi.',
+			'land_area_in_m2.string' => 'Luas lahan dalam m² harus berupa teks.',
+
+			'investment_amount.required' => 'Jumlah investasi harus diisi.',
+			'investment_amount.string' => 'Jumlah investasi harus berupa teks.',
+
+			'tki.required' => 'Jumlah tenaga kerja Indonesia harus diisi.',
+			'tki.string' => 'Jumlah tenaga kerja Indonesia harus berupa teks.',
+		];
+	}
 }

app/Http/Requests/UsersRequest.php

@@ -22,7 +22,7 @@ class UsersRequest extends FormRequest
      */
     public function rules(): array
     {
-        $userId = $this->route('user'); // Get user ID from route (used in update)
+        $userId = $this->route('users'); // Get user ID from route (used in update)
 
         return [
             'name' => ['required', 'string', 'max:255'],
@@ -31,7 +31,7 @@ class UsersRequest extends FormRequest
                 'string',
                 'email',
                 'max:255',
-                Rule::unique('users')->ignore($userId), // Ignore the user's own email when updating
+                Rule::unique('users')->ignore($userId)
             ],
             'password' => [$this->isMethod('post') ? 'required' : 'nullable', 'confirmed', 'max:255'],
             'firstname' => ['required', 'string', 'max:255'],

app/Http/Resources/BigdataResumeResource.php

@@ -0,0 +1,51 @@
+<?php
+
+namespace App\Http\Resources;
+
+use Illuminate\Http\Request;
+use Illuminate\Http\Resources\Json\JsonResource;
+
+class BigdataResumeResource extends JsonResource
+{
+    /**
+     * Transform the resource into an array.
+     *
+     * @return array<string, mixed>
+     */
+    public function toArray(Request $request): array
+    {
+        return [
+            'id' => $this->id,
+            'import_datasource_id' => $this->import_datasource_id,
+            'potention_count'      => (int) $this->potention_count,
+            'potention_sum'        => number_format((float) $this->potention_sum, 2, ',', '.'),
+
+            'non_verified_count'   => (int) $this->non_verified_count,
+            'non_verified_sum'     => number_format((float) $this->non_verified_sum, 2, ',', '.'),
+
+            'verified_count'       => (int) $this->verified_count,
+            'verified_sum'         => number_format((float) $this->verified_sum, 2, ',', '.'),
+
+            'business_count'       => (int) $this->business_count,
+            'business_sum'         => number_format((float) $this->business_sum, 2, ',', '.'),
+
+            'non_business_count'   => (int) $this->non_business_count,
+            'non_business_sum'     => number_format((float) $this->non_business_sum, 2, ',', '.'),
+
+            'spatial_count'        => (int) $this->spatial_count,
+            'spatial_sum'          => number_format((float) $this->spatial_sum, 2, ',', '.'),
+            
+            'issuance_realization_pbg_count'        => (int) $this->issuance_realization_pbg_count,
+            'issuance_realization_pbg_sum'          => number_format((float) $this->issuance_realization_pbg_sum, 2, ',', '.'),
+            
+            'waiting_click_dpmptsp_count'        => (int) $this->waiting_click_dpmptsp_count,
+            'waiting_click_dpmptsp_sum'          => number_format((float) $this->waiting_click_dpmptsp_sum, 2, ',', '.'),
+            
+            'process_in_technical_office_count'        => (int) $this->process_in_technical_office_count,
+            'process_in_technical_office_sum'          => number_format((float) $this->process_in_technical_office_sum, 2, ',', '.'),
+            
+            'year'                 => $this->year,
+            'created_at' => $this->created_at->toDateTimeString(),
+        ];
+    }
+}

app/Http/Resources/CustomersResource.php

@@ -0,0 +1,19 @@
+<?php
+
+namespace App\Http\Resources;
+
+use Illuminate\Http\Request;
+use Illuminate\Http\Resources\Json\JsonResource;
+
+class CustomersResource extends JsonResource
+{
+    /**
+     * Transform the resource into an array.
+     *
+     * @return array<string, mixed>
+     */
+    public function toArray(Request $request): array
+    {
+        return parent::toArray($request);
+    }
+}

app/Http/Resources/ImportDatasourceResource.php

@@ -2,6 +2,7 @@
 
 namespace App\Http\Resources;
 
+use Carbon\Carbon;
 use Illuminate\Http\Request;
 use Illuminate\Http\Resources\Json\JsonResource;
 
@@ -14,11 +15,18 @@ class ImportDatasourceResource extends JsonResource
      */
     public function toArray(Request $request): array
     {
+        $startTime = $this->start_time ? Carbon::parse($this->start_time) : null;
+        $finishTime = $this->finish_time ? Carbon::parse($this->finish_time) : null;
         return [
             "id"=> $this->id,
             "message" => $this->message,
             "response_body" => $this->response_body,
             "status" => $this->status,
+            "start_time" => $startTime ? $startTime->toDateTimeString() : null,
+            "duration" => ($startTime && $finishTime) 
+                ? $finishTime->diff($startTime)->format('%H:%I:%S') 
+                : null,
+            "finish_time" => $finishTime ? $finishTime->toDateTimeString() : null,
             "created_at" => $this->created_at->toDateTimeString(),
             "updated_at" => $this->updated_at->toDateTimeString(),
         ];

app/Http/Resources/MenuResource.php

@@ -0,0 +1,29 @@
+<?php
+
+namespace App\Http\Resources;
+
+use Illuminate\Http\Request;
+use Illuminate\Http\Resources\Json\JsonResource;
+
+class MenuResource extends JsonResource
+{
+    /**
+     * Transform the resource into an array.
+     *
+     * @return array<string, mixed>
+     */
+    public function toArray(Request $request): array
+    {
+        // return parent::toArray($request);
+        return [
+            'id' => $this->id,
+            'name' => $this->name,
+            'icon' => $this->icon,
+            'url' => $this->url,
+            'sort_order' => $this->sort_order,
+            'parent' => $this->parent ? new MenuResource($this->parent) : null,
+            'created_at' => $this->created_at,
+            'updated_at' => $this->updated_at
+        ];
+    }
+}

app/Http/Resources/PbgTaskGoogleSheetResource.php

@@ -0,0 +1,19 @@
+<?php
+
+namespace App\Http\Resources;
+
+use Illuminate\Http\Request;
+use Illuminate\Http\Resources\Json\JsonResource;
+
+class PbgTaskGoogleSheetResource extends JsonResource
+{
+    /**
+     * Transform the resource into an array.
+     *
+     * @return array<string, mixed>
+     */
+    public function toArray(Request $request): array
+    {
+        return parent::toArray($request);
+    }
+}

app/Http/Resources/SpatialPlanningResource.php

@@ -0,0 +1,19 @@
+<?php
+
+namespace App\Http\Resources;
+
+use Illuminate\Http\Request;
+use Illuminate\Http\Resources\Json\JsonResource;
+
+class SpatialPlanningResource extends JsonResource
+{
+    /**
+     * Transform the resource into an array.
+     *
+     * @return array<string, mixed>
+     */
+    public function toArray(Request $request): array
+    {
+        return parent::toArray($request);
+    }
+}

app/Http/Resources/SpatialPlanningsResource.php

@@ -0,0 +1,19 @@
+<?php
+
+namespace App\Http\Resources;
+
+use Illuminate\Http\Request;
+use Illuminate\Http\Resources\Json\JsonResource;
+
+class SpatialPlanningsResource extends JsonResource
+{
+    /**
+     * Transform the resource into an array.
+     *
+     * @return array<string, mixed>
+     */
+    public function toArray(Request $request): array
+    {
+        return parent::toArray($request);
+    }
+}

app/Http/Resources/TaskAssignmentsResource.php

@@ -0,0 +1,19 @@
+<?php
+
+namespace App\Http\Resources;
+
+use Illuminate\Http\Request;
+use Illuminate\Http\Resources\Json\JsonResource;
+
+class TaskAssignmentsResource extends JsonResource
+{
+    /**
+     * Transform the resource into an array.
+     *
+     * @return array<string, mixed>
+     */
+    public function toArray(Request $request): array
+    {
+        return parent::toArray($request);
+    }
+}

app/Imports/BusinessIndustriesImport.php

@@ -3,37 +3,105 @@
 namespace App\Imports;
 
 use App\Models\BusinessOrIndustry;
-use Maatwebsite\Excel\Concerns\ToModel;
-use Maatwebsite\Excel\Concerns\ToCollection;
 use Illuminate\Support\Collection;
+use Maatwebsite\Excel\Concerns\ToCollection;
+use Maatwebsite\Excel\Concerns\WithChunkReading;
+use Maatwebsite\Excel\Concerns\WithHeadingRow;
+use Maatwebsite\Excel\Concerns\WithMultipleSheets;
+use Illuminate\Contracts\Queue\ShouldQueue;
+use Maatwebsite\Excel\Concerns\WithBatchInserts;
+use Illuminate\Support\Facades\Log;
 
-class BusinessIndustriesImport implements ToCollection
+class BusinessIndustriesImport implements ToCollection, WithMultipleSheets, WithChunkReading, WithBatchInserts, ShouldQueue, WithHeadingRow
 {
     /**
-    * @param array $row
+    * @param Collection $collection
-    *
+    */    
-    * @return \Illuminate\Database\Eloquent\Model|null
+    public function collection(Collection $collection)
-    */
-    public function collection(Collection $rows)
     {
-        foreach ($rows->skip(1) as $row){
+        try{
-            $clean_nop = preg_replace('/[^A-Za-z0-9]/', '', $row[2]);
+            $batchData = [];
-            if (!BusinessOrIndustry::where('nop', $clean_nop)->exists()) {
+            $batchSize = 1000;
-                BusinessOrIndustry::create([
+    
-                    'nama_kecamatan'     => $row[0],
+            foreach ($collection as $row){
-                    'nama_kelurahan'     => $row[1],
+                if(!isset($row['nop']) || empty($row['nop'])){
-                    'nop'                => $clean_nop, // Store cleaned 'nop'
+                    continue;
-                    'nama_wajib_pajak'   => $row[3],
+                }
-                    'alamat_wajib_pajak' => $row[4], 
+    
-                    'alamat_objek_pajak' => $row[5], 
+    
-                    'luas_bumi'          => $row[6], 
+                $clean_nop = preg_replace('/[^A-Za-z0-9]/', '', $row['nop']);
-                    'luas_bangunan'      => $row[7], 
+    
-                    'njop_bumi'          => $row[8], 
+                $batchData[] = [
-                    'njop_bangunan'      => $row[9], 
+                        'nama_kecamatan'     => $row['nama_kecamatan'],
-                    'ketetapan'          => $row[10], 
+                        'nama_kelurahan'     => $row['nama_kelurahan'],
-                    'tahun_pajak'        => $row[11], 
+                        'nop'                => $clean_nop,
+                        'nama_wajib_pajak'   => $row['nama_wajib_pajak'],
+                        'alamat_wajib_pajak' => $row['alamat_wajib_pajak'], 
+                        'alamat_objek_pajak' => $row['alamat_objek_pajak'], 
+                        'luas_bumi'          => $row['luas_bumi'], 
+                        'luas_bangunan'      => $row['luas_bangunan'], 
+                        'njop_bumi'          => $row['njop_bumi'], 
+                        'njop_bangunan'      => $row['njop_bangunan'], 
+                        'ketetapan'          => $row['ketetapan'], 
+                        'tahun_pajak'        => $row['tahun_pajak'], 
+                ];
+    
+                if(count($batchData) >= $batchSize){
+                    BusinessOrIndustry::upsert($batchData, ['nop'], [
+                        'nama_kecamatan',
+                        'nama_kelurahan',
+                        'nama_wajib_pajak',
+                        'alamat_wajib_pajak',
+                        'alamat_objek_pajak',
+                        'luas_bumi',
+                        'luas_bangunan',
+                        'njop_bumi',
+                        'njop_bangunan',
+                        'ketetapan',
+                        'tahun_pajak',
+                    ]);
+                    $batchData = [];
+                }
+            }
+            if(!empty($batchData)){
+                BusinessOrIndustry::upsert($batchData, ['nop'], [
+                    'nama_kecamatan',
+                    'nama_kelurahan',
+                    'nama_wajib_pajak',
+                    'alamat_wajib_pajak',
+                    'alamat_objek_pajak',
+                    'luas_bumi',
+                    'luas_bangunan',
+                    'njop_bumi',
+                    'njop_bangunan',
+                    'ketetapan',
+                    'tahun_pajak',
                 ]);
             }
+        }catch(\Exception $exception){
+            Log::error('Error while importing Business Industries data:', ['error' => $exception->getMessage()]);
+            return;
         }
     }
+
+    public function sheets(): array {
+        return [
+            0 => $this
+        ];
+    }
+
+    public function headingRow(): int
+    {
+        return 1;
+    }
+
+    public function chunkSize(): int
+    {
+        return 1000;
+    }
+
+    public function batchSize(): int
+    {
+        return 1000;
+    }
 }

app/Imports/CustomersImport.php

@@ -0,0 +1,92 @@
+<?php
+
+namespace App\Imports;
+
+use App\Models\Customer;
+use Illuminate\Support\Collection;
+use Maatwebsite\Excel\Concerns\ToCollection;
+use Maatwebsite\Excel\Concerns\WithLimit;
+use Maatwebsite\Excel\Concerns\WithChunkReading;
+use Maatwebsite\Excel\Concerns\WithHeadingRow;
+use Maatwebsite\Excel\Concerns\WithMultipleSheets;
+use Illuminate\Contracts\Queue\ShouldQueue;
+use Maatwebsite\Excel\Concerns\WithBatchInserts;
+use Illuminate\Support\Facades\Log;
+
+class CustomersImport implements ToCollection, WithMultipleSheets, WithChunkReading, WithBatchInserts, ShouldQueue, WithHeadingRow
+{
+    /**
+    * @param Collection $collection
+    */    
+    public function collection(Collection $collection)
+    {
+        $batchData = [];
+        $batchSize = 1000;
+
+        foreach ($collection as $row) {
+            if (!isset($row['nomor_pelanggan']) || empty($row['nomor_pelanggan'])) {
+                continue;
+            }
+
+            $latitude = '0';
+            $longitude = '0';
+
+            if (isset($row['latkor']) && !empty(trim($row['latkor']))) {
+                $latitude = str_replace(',', '.', trim($row['latkor']));
+                if (is_numeric($latitude)) {
+                    $latitude = bcadd($latitude, '0', 18); 
+                } else {
+                    $latitude = '0'; 
+                }
+            } else {
+                $latitude = '0';
+            }
+
+            if (isset($row['lonkor']) && !empty(trim($row['lonkor']))) {
+                $longitude = str_replace(',', '.', trim($row['lonkor'])); 
+                if (is_numeric($longitude)) {
+                    $longitude = bcadd($longitude, '0', 18); 
+                } else {
+                    $longitude = '0';
+                }
+            } else {
+                $longitude = '0';
+            }
+
+            $batchData[] = [
+                'nomor_pelanggan' => $row['nomor_pelanggan'] ?? '',
+                'kota_pelayanan' => $row['kota_pelayanan'] ?? '',
+                'nama' => $row['nama'] ?? '',
+                'alamat' => $row['alamat'] ?? '',
+                'latitude' => $latitude,
+                'longitude' => $longitude,
+            ];
+
+            if (count($batchData) >= $batchSize) {
+                Customer::upsert($batchData, ['nomor_pelanggan'], ['kota_pelayanan', 'nama', 'alamat', 'latitude', 'longitude']);
+                $batchData = [];
+            }
+        }
+
+        if (!empty($batchData)) {
+            Customer::upsert($batchData, ['nomor_pelanggan'], ['kota_pelayanan', 'nama', 'alamat', 'latitude', 'longitude']);
+        }
+    }
+
+
+    public function sheets(): array {
+        return [
+            0 => $this
+        ];
+    }
+
+    public function chunkSize(): int
+    {
+        return 1000;
+    }
+
+    public function batchSize(): int
+    {
+        return 1000;
+    }
+}

app/Imports/SpatialPlanningImport.php

@@ -0,0 +1,63 @@
+<?php
+
+namespace App\Imports;
+
+use App\Models\SpatialPlanning;
+use Illuminate\Support\Collection;
+use Maatwebsite\Excel\Concerns\ToCollection;
+use Illuminate\Support\Facades\DB;
+use DateTime;
+use Carbon\Carbon;
+
+class SpatialPlanningImport implements ToCollection
+{
+    protected static $processed = false;
+
+    /**
+     * Process each row in the file
+     */
+    public function collection(Collection $rows)
+    {
+        if (self::$processed) {
+            return;
+        }
+        self::$processed = true;
+
+        if ($rows->isEmpty())
+        {
+            return;
+        }
+
+        //cari header secara otomatis
+        $header = $rows->first();
+        $headerIndex = collect($header)->search(fn($value) => !empty($value));
+
+        // Pastikan header ditemukan
+        if ($headerIndex === false) {
+            return;
+        }
+
+        foreach ($rows->skip(1) as $row) {
+            $dateValue = trim($row[7]);
+            info($dateValue);
+            $parsedDate = Carbon::createFromFormat('Y-m-d', $dateValue)->format('Y-m-d');
+            info($parsedDate); 
+
+            $dataToInsert[] = [
+                'name'=>$row[1],
+                'kbli'=>$row[2],
+                'activities'=>$row[3],
+                'area'=>$row[4],
+                'location'=>$row[5],
+                'number'=>$row[6],
+                'date'=>$parsedDate,
+            ];
+        }
+
+        if(!empty($dataToInsert)) {
+            SpatialPlanning::insert($dataToInsert);
+        } else {
+            return;
+        }
+    }
+}

app/Imports/TourismImport.php

@@ -65,13 +65,6 @@ class TourismImport implements ToCollection
             // ambill village code yang village_name sama dengan $villageName
             $villageCode = $listTrueVillage[$villageName]['village_code'] ?? '000000';
 
-            
-            // if (empty($row[16])) {
-            //     info("Data kosong");
-            // } else {
-            //     info("Baris ke- | Nilai: " . $row[16]);
-            // }
-
             $excelSerialDate = $row[16];
             if (is_numeric($excelSerialDate)) {
                 $projectSubmissionDate = Carbon::createFromFormat('Y-m-d', '1899-12-30')
@@ -82,8 +75,6 @@ class TourismImport implements ToCollection
                     ->format('Y-m-d H:i:s');
             }
 
-            info("Tanggal dikonversi: " . $projectSubmissionDate);
-
             $dataToInsert[] = [
                 'project_id' => $row[1],
                 'project_type_id' => $row[2],

app/Jobs/ScrapingDataJob.php

@@ -0,0 +1,77 @@
+<?php
+
+namespace App\Jobs;
+
+use App\Models\ImportDatasource;
+use App\Services\ServiceGoogleSheet;
+use App\Services\ServicePbgTask;
+use App\Services\ServiceTabPbgTask;
+use App\Services\ServiceTokenSIMBG;
+use GuzzleHttp\Client;
+use Illuminate\Bus\Queueable;
+use Illuminate\Contracts\Queue\ShouldQueue;
+use Illuminate\Foundation\Bus\Dispatchable;
+use Illuminate\Queue\InteractsWithQueue;
+use Illuminate\Queue\SerializesModels;
+use Illuminate\Support\Facades\Log;
+
+class ScrapingDataJob implements ShouldQueue
+{
+    use Dispatchable, InteractsWithQueue, Queueable, SerializesModels;
+
+    /**
+     * Inject dependencies instead of creating them inside.
+     */
+    public function __construct(
+    ) {
+    }
+
+    /**
+     * Execute the job.
+     */
+    public function handle()
+    {
+        try {
+
+            $client = app(Client::class);
+            $service_pbg_task = app(ServicePbgTask::class);
+            $service_tab_pbg_task = app(ServiceTabPbgTask::class);
+            $service_google_sheet = app(ServiceGoogleSheet::class);
+            $service_token = app(ServiceTokenSIMBG::class);
+            // Create a record with "processing" status
+            $import_datasource = ImportDatasource::create([
+                'message' => 'Initiating scraping...',
+                'response_body' => null,
+                'status' => 'processing',
+                'start_time' => now()
+            ]);
+
+            // Run the scraping services
+            $service_google_sheet->run_service();
+            $service_pbg_task->run_service();
+            $service_tab_pbg_task->run_service();
+
+            // Update status to success
+            $import_datasource->update([
+                'status' => 'success',
+                'message' => 'Scraping completed successfully.',
+                'finish_time' => now()
+            ]);
+
+        } catch (\Exception $e) {
+            Log::error('Scraping failed: ' . $e->getMessage(), ['trace' => $e->getTraceAsString()]);
+
+            // Update status to failed
+            if (isset($import_datasource)) {
+                $import_datasource->update([
+                    'status' => 'failed',
+                    'response_body' => 'Error: ' . $e->getMessage(),
+                    'finish_time' => now()
+                ]);
+            }
+
+            // Mark the job as failed
+            $this->fail($e);
+        }
+    }
+}

app/Jobs/SyncronizeSIMBG.php

@@ -0,0 +1,80 @@
+<?php
+
+namespace App\Jobs;
+
+use App\Models\ImportDatasource;
+use App\Services\GoogleSheetService;
+use App\Services\ServiceGoogleSheet;
+use App\Services\ServicePbgTask;
+use App\Services\ServiceTabPbgTask;
+use GuzzleHttp\Client;
+use Illuminate\Bus\Queueable;
+use Illuminate\Contracts\Queue\ShouldQueue;
+use Illuminate\Foundation\Bus\Dispatchable;
+use Illuminate\Queue\InteractsWithQueue;
+use Illuminate\Queue\SerializesModels;
+
+class SyncronizeSIMBG implements ShouldQueue
+{
+    use Dispatchable, InteractsWithQueue, Queueable, SerializesModels;
+
+    public $tries = 1;
+
+    public function __construct()
+    {
+        // Avoid injecting non-serializable dependencies here
+    }
+
+    public function handle(): void
+    {
+        $import_datasource = ImportDatasource::where('status', 'processing')->first();
+
+        if (!$import_datasource) {
+            $import_datasource = ImportDatasource::create([
+                'message' => 'Initiating scraping...',
+                'response_body' => null,
+                'status' => 'processing'
+            ]);
+        }
+        try {
+            // Create an instance of GuzzleHttp\Client inside handle()
+            $client = new Client();
+
+            // Create instances of services inside handle()
+            $service_pbg_task = app(ServicePbgTask::class);
+            $service_tab_pbg_task = app(ServiceTabPbgTask::class);
+
+            // Create a record with "processing" status
+
+
+            // Run the service
+            $service_google_sheet = new ServiceGoogleSheet();
+            \Log::info('Starting Google Sheet service');
+            $service_google_sheet->run_service();
+            \Log::info('Google Sheet service completed');
+
+            \Log::info('Starting PBG Task service');
+            $service_pbg_task->run_service();
+            \Log::info('PBG Task service completed');
+
+            \Log::info('Starting Tab PBG Task service');
+            $service_tab_pbg_task->run_service();
+            \Log::info('Tab PBG Task service completed');
+
+            // Update the record status to "success" after completion
+            $import_datasource->update([
+                'status' => 'success',
+                'message' => 'Scraping completed successfully.'
+            ]);
+        } catch (\Exception $e) {
+            \Log::error("SyncronizeSIMBG Job Failed: " . $e->getMessage(), [
+                'exception' => $e,
+            ]);
+            $import_datasource->update([
+                'status' => 'failed',
+                'message' => 'Failed job'
+            ]);
+            $this->fail($e); // Mark the job as failed
+        }
+    }
+}

app/Models/BigdataResume.php

@@ -21,6 +21,15 @@ class BigdataResume extends Model
         'business_sum',
         'non_business_count',
         'non_business_sum',
+        'spatial_count',
+        'spatial_sum',
+        'year',
+        'waiting_click_dpmptsp_count',
+        'waiting_click_dpmptsp_sum',
+        'issuance_realization_pbg_count',
+        'issuance_realization_pbg_sum',
+        'process_in_technical_office_count',
+        'process_in_technical_office_sum',
     ];
 
     public function importDatasource()
@@ -28,88 +37,84 @@ class BigdataResume extends Model
         return $this->belongsTo(ImportDatasource::class, 'import_datasource_id');
     }
 
-    public static function generateResumeData($import_datasource_id){
+    public static function generateResumeData($import_datasource_id, $year, $data_setting){
-        $query_verified = once( function () {
+        $stats = PbgTask::with(['googleSheet', 'pbg_task_retributions'])
-            return DB::table('pbg_task AS pt')
+            ->leftJoin('pbg_task_retributions as ptr', 'pbg_task.uuid', '=', 'ptr.pbg_task_uid')
-                ->leftJoin('pbg_task_google_sheet AS ptgs', 'pt.registration_number', '=', 'ptgs.no_registrasi')
+            ->leftJoin('pbg_task_google_sheet as ptgs', 'pbg_task.registration_number', '=', 'ptgs.no_registrasi')
-                ->leftJoin('pbg_task_retributions AS ptr', 'pt.uuid', '=', 'ptr.pbg_task_uid')
+            ->when($year !== 'all', function ($query) use ($year) {
-                ->whereRaw('LOWER(TRIM(ptgs.status_verifikasi)) = ?', [strtolower(trim('Selesai Verifikasi'))])
+                $query->whereYear('pbg_task.task_created_at', (int) $year);
-                ->selectRaw('COUNT(pt.id) AS total_data, 
-                            SUM(ptr.nilai_retribusi_bangunan) AS total_retribution') 
-                ->first();
-        }); 
-
-        $verified_count = $query_verified->total_data ?? 0;
-        $verified_total = $query_verified->total_retribution ?? 0;
-
-        $query_business = once(function () {
-            return DB::table('pbg_task AS pt')
-                ->leftJoin('pbg_task_google_sheet AS ptgs', 'pt.registration_number', '=', 'ptgs.no_registrasi')
-                ->leftJoin('pbg_task_retributions AS ptr', 'pt.uuid', '=', 'ptr.pbg_task_uid')
-                ->where(function ($query) {
-                    $query->whereRaw('LOWER(TRIM(ptgs.status_verifikasi)) != ?', [strtolower(trim('Selesai Verifikasi'))])
-                        ->orWhereNull('ptgs.status_verifikasi');
-                })
-                ->where(function ($query) {
-                    $query->whereRaw('LOWER(TRIM(pt.function_type)) = ?', [strtolower(trim('Sebagai Tempat Usaha'))]);
-                })
-                ->selectRaw('COUNT(pt.id) AS total_data, 
-                            SUM(ptr.nilai_retribusi_bangunan) AS total_retribution')
-                ->first();
-        });
-
-        $business_count = $query_business->total_data ?? 0;
-        $business_total = $query_business->total_retribution ?? 0;
-
-        $query_non_business = once( function () {
-            return DB::table('pbg_task AS pt')
-            ->leftJoin('pbg_task_google_sheet AS ptgs', 'pt.registration_number', '=', 'ptgs.no_registrasi')
-            ->leftJoin('pbg_task_retributions AS ptr', 'pt.uuid', '=', 'ptr.pbg_task_uid') // Join ke pbg_task_retributions
-            ->where(function ($query) {
-                $query->whereRaw('LOWER(TRIM(ptgs.status_verifikasi)) != ?', [strtolower(trim('Selesai Verifikasi'))])
-                    ->orWhereNull('ptgs.status_verifikasi'); // Include NULL values
             })
-            ->where(function ($query) {
+            ->selectRaw("
-                $query->whereRaw('LOWER(TRIM(pt.function_type)) != ?', [strtolower(trim('Sebagai Tempat Usaha'))])
+                COUNT(CASE WHEN LOWER(TRIM(ptgs.status_verifikasi)) = 'selesai verifikasi' THEN 1 END) AS verified_count,
-                    ->orWhereNull('pt.function_type'); // Include NULL values
+                SUM(CASE WHEN LOWER(TRIM(ptgs.status_verifikasi)) = 'selesai verifikasi' THEN ptr.nilai_retribusi_bangunan ELSE 0 END) AS verified_total,
-            })
+                
-            ->selectRaw('COUNT(pt.id) AS total_data, 
+                COUNT(CASE WHEN LOWER(TRIM(ptgs.status_verifikasi)) != 'selesai verifikasi' OR ptgs.status_verifikasi IS NULL THEN 1 END) AS non_verified_count,
-                        SUM(ptr.nilai_retribusi_bangunan) AS total_retribution') // Menambahkan SUM dari pbg_task_retributions
+                SUM(CASE WHEN LOWER(TRIM(ptgs.status_verifikasi)) != 'selesai verifikasi' OR ptgs.status_verifikasi IS NULL THEN ptr.nilai_retribusi_bangunan ELSE 0 END) AS non_verified_total,
-            ->first();
+                
-        });
+                COUNT(CASE WHEN (LOWER(TRIM(ptgs.status_verifikasi)) != 'selesai verifikasi' OR ptgs.status_verifikasi IS NULL) 
-        $non_business_count = $query_non_business->total_data ?? 0;
+                        AND LOWER(TRIM(pbg_task.function_type)) = 'sebagai tempat usaha' THEN 1 END) AS business_count,
-        $non_business_total = $query_non_business->total_retribution ?? 0;
+                SUM(CASE WHEN (LOWER(TRIM(ptgs.status_verifikasi)) != 'selesai verifikasi' OR ptgs.status_verifikasi IS NULL) 
+                        AND LOWER(TRIM(pbg_task.function_type)) = 'sebagai tempat usaha' THEN ptr.nilai_retribusi_bangunan ELSE 0 END) AS business_total,
 
-        $query_non_verified = once(function () {
+                COUNT(CASE WHEN (LOWER(TRIM(ptgs.status_verifikasi)) != 'selesai verifikasi' OR ptgs.status_verifikasi IS NULL) 
-            return DB::table('pbg_task AS pt')
+                        AND (LOWER(TRIM(pbg_task.function_type)) != 'sebagai tempat usaha' OR pbg_task.function_type IS NULL) THEN 1 END) AS non_business_count,
-            ->leftJoin('pbg_task_google_sheet AS ptgs', 'pt.registration_number', '=', 'ptgs.no_registrasi')
+                SUM(CASE WHEN (LOWER(TRIM(ptgs.status_verifikasi)) != 'selesai verifikasi' OR ptgs.status_verifikasi IS NULL) 
-            ->leftJoin('pbg_task_retributions AS ptr', 'pt.uuid', '=', 'ptr.pbg_task_uid') // Join tabel pbg_task_retributions
+                        AND (LOWER(TRIM(pbg_task.function_type)) != 'sebagai tempat usaha' OR pbg_task.function_type IS NULL) THEN ptr.nilai_retribusi_bangunan ELSE 0 END) AS non_business_total
-            ->where(function ($query) {
+            ")
-                $query->whereRaw('LOWER(TRIM(ptgs.status_verifikasi)) != ?', [strtolower(trim('Selesai Verifikasi'))])
-                    ->orWhereNull('ptgs.status_verifikasi'); // Include NULL values
-            })
-            ->selectRaw('COUNT(pt.id) AS total_data, 
-                        SUM(ptr.nilai_retribusi_bangunan) AS total_retribution') // Menambahkan SUM dari pbg_task_retributions
             ->first();
+
+        // Assign Results
+        $verified_count = $stats->verified_count ?? 0;
+        $verified_total = $stats->verified_total ?? 0;
+        $non_verified_count = $stats->non_verified_count ?? 0;
+        $non_verified_total = $stats->non_verified_total ?? 0;
+        $business_count = $stats->business_count ?? 0;
+        $business_total = $stats->business_total ?? 0;
+        $non_business_count = $stats->non_business_count ?? 0;
+        $non_business_total = $stats->non_business_total ?? 0;
+
+        $query_potention = once(function () use ($year) {
+            $query = PbgTask::leftJoin('pbg_task_retributions as ptr', 'pbg_task.uuid', '=', 'ptr.pbg_task_uid')
+                ->selectRaw('COUNT(DISTINCT pbg_task.id) as task_count, SUM(ptr.nilai_retribusi_bangunan) as total_retribution');
+
+            if ($year !== 'all') {
+                $query->whereYear('pbg_task.task_created_at', (int) $year);
+            }
+
+            return $query->first();
         });
 
-        $non_verified_count = $query_non_verified->total_data ?? 0;
-        $non_verified_total = $query_non_verified->total_retribution ?? 0;
-
-        $query_potention = once( function () {
-            return DB::table('pbg_task as pt')
-            ->leftJoin('pbg_task_retributions as ptr', 'pt.uuid', '=', 'ptr.pbg_task_uid')
-            ->select(
-                DB::raw('COUNT(DISTINCT pt.id) as task_count'),
-                DB::raw('SUM(ptr.nilai_retribusi_bangunan) as total_retribution')
-            )
-            ->first();
-        });
         $potention_count = $query_potention->task_count ?? 0;
         $potention_total = $query_potention->total_retribution ?? 0;
 
+        $query_spatial_plannings = once(function () use ($year) {
+            $query = PbgTask::leftJoin('spatial_plannings as sp', 'pbg_task.document_number', '=', 'sp.number')
+                ->leftJoin('pbg_task_retributions as ptr', 'ptr.pbg_task_uid', '=', 'pbg_task.uuid')
+                ->selectRaw('
+                    CASE 
+                        WHEN COUNT(DISTINCT sp.id) > 0 THEN COUNT(DISTINCT sp.id)
+                        ELSE (SELECT COUNT(*) FROM spatial_plannings) 
+                    END as task_count,
+                    SUM(CASE WHEN sp.id IS NOT NULL AND ptr.id IS NOT NULL THEN ptr.nilai_retribusi_bangunan ELSE 0 END) as total_retribution
+                ');
+
+            if ($year !== 'all') {
+                $query->whereYear('pbg_task.task_created_at', (int) $year);
+            }
+
+            return $query->first();
+        });
+
+        $spatial_planning_count = $query_spatial_plannings->task_count ?? 0;
+        $spatial_planning_total = $query_spatial_plannings->total_retribution;
+
+        $potention_count -= $spatial_planning_count;
+        $potention_total -= $spatial_planning_total;
+
         return self::create([
             'import_datasource_id' => $import_datasource_id,
+            'spatial_count' => $spatial_planning_count,
+            'spatial_sum' => $spatial_planning_total ?? 0.00,
             'potention_count' => $potention_count ?? 0,
             'potention_sum' => $potention_total ?? 0.00,
             'non_verified_count' => $non_verified_count ?? 0,
@@ -120,6 +125,13 @@ class BigdataResume extends Model
             'business_sum' => $business_total ?? 0.00,
             'non_business_count' => $non_business_count ?? 0,
             'non_business_sum' => $non_business_total ?? 0.00,
+            'year' => $year,
+            'waiting_click_dpmptsp_count' => $data_setting['MENUNGGU_KLIK_DPMPTSP_COUNT'] ?? 0,
+            'waiting_click_dpmptsp_sum' => $data_setting['MENUNGGU_KLIK_DPMPTSP_SUM'] ?? 0.00,
+            'issuance_realization_pbg_count' => $data_setting['REALISASI_TERBIT_PBG_COUNT'] ?? 0,
+            'issuance_realization_pbg_sum' => $data_setting['REALISASI_TERBIT_PBG_SUM'] ?? 0.00,
+            'process_in_technical_office_count' => $data_setting['PROSES_DINAS_TEKNIS_COUNT'] ?? 0,
+            'process_in_technical_office_sum' => $data_setting['PROSES_DINAS_TEKNIS_SUM'] ??0.00,
         ]);
     }
 }

app/Models/Customer.php

@@ -0,0 +1,20 @@
+<?php
+
+namespace App\Models;
+
+use Illuminate\Database\Eloquent\Model;
+
+class Customer extends Model
+{
+    protected $table = 'customers';
+    protected $fillable = [
+        'nomor_pelanggan',
+        'kota_pelayanan',
+        'nama',
+        'alamat',
+        'latitude',
+        'longitude',
+    ];
+
+    
+}

app/Models/ImportDatasource.php

@@ -13,6 +13,8 @@ class ImportDatasource extends Model
         'id',
         'message',
         'response_body',
-        'status'
+        'status',
+        'start_time',
+        'finish_time'
     ];
 }

app/Models/Menu.php

@@ -22,4 +22,7 @@ class Menu extends Model
     public function children(){
         return $this->hasMany(Menu::class,'parent_id');
     }
+    public function parent(){
+        return $this->belongsTo(Menu::class,'parent_id');
+    }
 }

app/Models/PbgTask.php

@@ -37,4 +37,13 @@ class PbgTask extends Model
     public function pbg_task_index_integrations(){
         return $this->hasOne(PbgTaskIndexIntegrations::class, 'pbg_task_uid', 'uuid');
     }
+
+    public function googleSheet(){
+        return $this->hasOne(PbgTaskGoogleSheet::class, 'no_registrasi', 'registration_number');
+    }
+
+    public function taskAssignments()
+    {
+        return $this->hasMany(TaskAssignment::class, 'pbg_task_uid', 'uuid');
+    }
 }

app/Models/RoleMenu.php

@@ -18,6 +18,13 @@ class RoleMenu extends Model
         'allow_destroy',
     ];
 
+    protected $casts = [
+        'allow_show' => 'boolean',
+        'allow_create' => 'boolean',
+        'allow_update' => 'boolean',
+        'allow_destroy' => 'boolean',
+    ];
+
     public $timestamps = true;
 
     public function role(){

app/Models/SpatialPlanning.php

@@ -0,0 +1,37 @@
+<?php
+
+namespace App\Models;
+
+use Illuminate\Database\Eloquent\Model;
+
+/**
+ * Class SpatialPlanning
+ *
+ * @property $id
+ * @property $created_at
+ * @property $updated_at
+ * @property $name
+ * @property $kbli
+ * @property $activities
+ * @property $area
+ * @property $location
+ * @property $number
+ * @property $date
+ *
+ * @package App
+ * @mixin \Illuminate\Database\Eloquent\Builder
+ */
+class SpatialPlanning extends Model
+{
+    
+    protected $perPage = 20;
+
+    /**
+     * The attributes that are mass assignable.
+     *
+     * @var array<int, string>
+     */
+    protected $fillable = ['name', 'kbli', 'activities', 'area', 'location', 'number', 'date'];
+
+
+}

app/Models/TaskAssignment.php

@@ -0,0 +1,28 @@
+<?php
+
+namespace App\Models;
+
+use Illuminate\Database\Eloquent\Model;
+use Illuminate\Database\Eloquent\Factories\HasFactory;
+
+class TaskAssignment extends Model
+{
+    use HasFactory;
+
+    protected $fillable = [
+        'user_id', 'name', 'username', 'email', 'phone_number', 'role',
+        'role_name', 'is_active', 'file', 'expertise', 'experience',
+        'is_verif', 'uid', 'status', 'status_name', 'note', 'pbg_task_uid', 'tas_id'
+    ];
+
+    protected $casts = [
+        'is_active' => 'boolean',
+        'is_verif' => 'boolean',
+        'file' => 'array', // JSON field casting
+    ];
+
+    public function pbgTask()
+    {
+        return $this->belongsTo(PbgTask::class, 'pbg_task_uid', 'uuid');
+    }
+}

app/Models/User.php

@@ -4,6 +4,7 @@ namespace App\Models;
 
 // use Illuminate\Contracts\Auth\MustVerifyEmail;
 use Illuminate\Database\Eloquent\Factories\HasFactory;
+use Illuminate\Database\Eloquent\SoftDeletes;
 use Illuminate\Foundation\Auth\User as Authenticatable;
 use Illuminate\Notifications\Notifiable;
 use Laravel\Sanctum\HasApiTokens;
@@ -11,7 +12,7 @@ use Laravel\Sanctum\HasApiTokens;
 class User extends Authenticatable
 {
     /** @use HasFactory<\Database\Factories\UserFactory> */
-    use HasFactory, Notifiable, HasApiTokens;
+    use HasFactory, Notifiable, HasApiTokens, SoftDeletes;
 
     /**
      * The attributes that are mass assignable.
@@ -27,6 +28,8 @@ class User extends Authenticatable
         'position'
     ];
 
+    protected $dates = ['deleted_at'];
+
     /**
      * The attributes that should be hidden for serialization.
      *
@@ -50,7 +53,20 @@ class User extends Authenticatable
         ];
     }
 
+    public function delete(){
+        $this->email = $this->email . '_deleted_'. now()->timestamp;
+        $this->save();
+        return parent::delete();
+    }
+
     public function roles(){
         return $this->belongsToMany(Role::class, 'user_role')->withTimestamps();
     }
+
+    public function menus(){
+        return Menu::whereHas('roles', function ($query){
+            $query->whereIn('roles.id', $this->roles->pluck('id'))
+            ->where('role_menu.allow_show', true);
+        });
+    }
 }

app/Providers/AppServiceProvider.php

@@ -3,12 +3,19 @@
 namespace App\Providers;
 
 use App\Models\Menu;
+use App\Services\ServiceGoogleSheet;
+use App\Services\ServicePbgTask;
+use App\Services\ServiceTabPbgTask;
+use App\Services\ServiceTokenSIMBG;
 use App\View\Components\Circle;
 use Auth;
+use GuzzleHttp\Client;
 use Illuminate\Support\Facades\Blade;
 use Illuminate\Support\Facades\View;
 use Illuminate\Support\ServiceProvider;
 use Carbon\Carbon;
+use App\Services\ServiceSIMBG;
+use App\Services\GoogleSheetService;
 
 class AppServiceProvider extends ServiceProvider
 {
@@ -17,7 +24,25 @@ class AppServiceProvider extends ServiceProvider
      */
     public function register(): void
     {
-        //
+        $this->app->bind(Client::class, function () {
+            return new Client();
+        });
+
+        $this->app->bind(ServiceTokenSIMBG::class, function ($app) {
+            return new ServiceTokenSIMBG();
+        });
+
+        $this->app->bind(ServicePbgTask::class, function ($app) {
+            return new ServicePbgTask($app->make(Client::class), $app->make(ServiceTokenSIMBG::class));
+        });
+
+        $this->app->bind(ServiceTabPbgTask::class, function ($app) {
+            return new ServiceTabPbgTask($app->make(Client::class), $app->make(ServiceTokenSIMBG::class));
+        });
+
+        $this->app->bind(ServiceGoogleSheet::class, function ($app) {
+            return new ServiceGoogleSheet();
+        });
     }
 
     /**
@@ -27,21 +52,24 @@ class AppServiceProvider extends ServiceProvider
     {
         Blade::component('circle', Circle::class);
 
-        View::composer('layouts.partials.sidebar', function ($view){
+        View::composer('layouts.partials.sidebar', function ($view) {
             $user = Auth::user();
 
-            if($user){
+            if ($user) {
-                $menus = Menu::whereHas('roles', function ($query) use ($user){
+                $menus = Menu::whereHas('roles', function ($query) use ($user) {
-                    $query->where('roles.id', $user->roles->pluck('id'));
+                        $query->whereIn('roles.id', $user->roles->pluck('id'))
-                })
+                            ->where('role_menu.allow_show', 1);
-                ->with(['children' => function ($query) {
+                    })
-                    $query->whereHas('roles', function ($subQuery) {
+                    ->with(['children' => function ($query) use ($user) {
-                        $subQuery->where('role_menu.allow_show', 1);
+                        $query->whereHas('roles', function ($subQuery) use ($user) {
-                    });
+                            $subQuery->whereIn('roles.id', $user->roles->pluck('id'))
-                }])
+                                    ->where('role_menu.allow_show', 1);
-                ->orderBy('sort_order', 'asc')
+                        });
-                ->get();
+                    }])
-            }else{
+                    ->whereNull('parent_id') // Ambil hanya menu utama
+                    ->orderBy('sort_order', 'asc')
+                    ->get();
+            } else {
                 $menus = collect();
             }
 

app/Providers/RouteServiceProvider.php

@@ -17,7 +17,7 @@ class RouteServiceProvider extends ServiceProvider
      *
      * @var string
      */
-    public const HOME = '/dashboards/bigdata';
+    public const HOME = '/home';
 
     /**
      * Define your route model bindings, pattern filters, and other route configuration.

app/Services/GoogleSheetService.php

@@ -13,6 +13,7 @@ class GoogleSheetService
     protected $client;
     protected $service;
     protected $spreadsheetID;
+    protected $service_sheets;
     public function __construct()
     {
         $this->client = new Google_Client();

app/Services/OpenAIService.php

@@ -0,0 +1,276 @@
+<?php
+
+namespace App\Services;
+
+use OpenAI;
+use Illuminate\Support\Facades\Storage;
+use Illuminate\Support\Facades\Log;
+
+class OpenAIService
+{
+    protected $client;
+
+    public function __construct()
+    {
+        // $this->client = OpenAI::client(env('OPENAI_API_KEY'));
+        $this->client = OpenAI::client(env('OPENAI_API_KEY'));
+    }
+
+    public function generateQueryBasedMainContent($prompt, $mainContent, $chatHistory)
+    {
+        // Load file JSON
+        $jsonPath = public_path('templates/contentTemplatePrompt.json'); // Sesuaikan path
+        $jsonData = json_decode(file_get_contents($jsonPath), true);
+
+        // Periksa apakah kategori ada dalam JSON
+        if (!isset($jsonData[$mainContent])) {
+            return "Template prompt tidak ditemukan.";
+        }
+
+        // Ambil template berdasarkan kategori
+        $promptTemplate = $jsonData[$mainContent]['prompt'];
+
+        // Menyusun pesan untuk OpenAI
+        $messages = [
+            ['role' => 'system', 'content' => $promptTemplate],
+        ];
+
+        // Menambahkan chat history sebagai konteks
+        foreach ($chatHistory as $chat) {
+            if (isset($chat['user'])) {
+                $messages[] = ['role' => 'user', 'content' => $chat['user']];
+            }
+            if (isset($chat['rawBotResponse'])) {
+                $messages[] = ['role' => 'assistant', 'content' => $chat['rawBotResponse']];
+            }
+        }
+
+        // Tambahkan prompt terbaru user
+        $messages[] = ['role' => 'user', 'content' => $prompt];
+
+        // Kirim request ke OpenAI API
+        $response = $this->client->chat()->create([
+            'model' => 'gpt-4o-mini',
+            'messages' => $messages,
+        ]);
+
+        return trim($response['choices'][0]['message']['content'] ?? 'No response');
+    }
+
+    
+    // public function generateQueryBasedMainContent($prompt, $mainContent, $chatHistory)
+    // {
+    //     // Load file JSON
+    //     $jsonPath = public_path('templates/contentTemplatePrompt.json'); // Sesuaikan path
+    //     $jsonData = json_decode(file_get_contents($jsonPath), true);
+
+    //     // Periksa apakah kategori ada dalam JSON
+    //     if (!isset($jsonData[$mainContent])) {
+    //         return "Template prompt tidak ditemukan.";
+    //     }
+
+    //     // Ambil template berdasarkan kategori
+    //     $promptTemplate = $jsonData[$mainContent]['prompt'];
+
+    //     $response = $this->client->chat()->create([
+    //         'model' => 'gpt-4o-mini',
+    //         'messages' => [
+    //             ['role' => 'system', 'content' => $promptTemplate],
+    //             ['role' => 'user', 'content' => $prompt],
+    //         ],
+    //     ]);
+
+    //     return trim($response['choices'][0]['message']['content'] ?? 'No response');
+    // }
+
+
+    public function validateSyntaxQuery($queryResponse)
+    {
+        $response = $this->client->chat()->create([
+            'model' => 'gpt-4o-mini',
+            'messages' => [
+                [
+                    'role' => 'system', 
+                    'content' => "You are a MariaDB SQL expert. Your task is to validate the syntax of an SQL query to ensure it follows proper MariaDB syntax rules. 
+
+                    Guidelines:
+                    - Check for any syntax errors, missing keywords, or incorrect clause usage.
+                    - Ensure the query is well-structured and adheres to best practices.
+                    - Verify that all SQL keywords are used correctly and in the right order.
+                    - If the query is valid, respond with: \"VALID\".
+                    - If the query has issues, respond with: \"INVALID\".
+                    
+                    Always respond with either \"VALID\" or \"INVALID\"."
+                ],
+                ['role' => 'user', 'content' => $queryResponse],
+            ],
+        ]);
+
+        return trim($response['choices'][0]['message']['content'] ?? 'No response');
+    }
+
+    public function generateNLPFromQuery($inputUser, $resultQuery) {
+        $response = $this->client->chat()->create([
+            'model' => 'gpt-4o-mini',
+            'messages' => [
+                [
+                    'role' => 'system', 
+                    'content' => "You are an expert assistant. Your task is to analyze the database query results and transform them into a human-readable answer based on the user's question.
+    
+                    Guidelines:
+                    - Understand the user's question and extract the key intent.
+                    - Summarize or format the query results to directly answer the user's question.
+                    - Ensure the response is clear, concise, and relevant.
+                    - If the query result is empty or does not match the question, provide a polite response indicating that no data is available.
+    
+                    Always provide a well-structured response that makes sense based on the input question."
+                ],
+                ['role' => 'user', 'content' => "User's question: $inputUser \nDatabase result: $resultQuery"],
+            ],
+        ]);
+    
+        return trim($response['choices'][0]['message']['content'] ?? 'No response');
+    }
+
+    public function generateFinalText($nlpResult) {
+        $response = $this->client->chat()->create([
+            'model' => 'gpt-4o-mini',
+            'messages' => [
+                [
+                    'role' => 'system',
+                    'content' => "You are an expert text formatter. Your task is to take the given NLP result and format it into a structured, human-readable text suitable for rendering inside an HTML <div>.
+    
+                    Guidelines:
+                    - Preserve the meaning and clarity of the content.
+                    - Use proper line breaks for readability.
+                    - If the text contains lists, convert them into bullet points.
+                    - Emphasize important keywords using <strong> tags if necessary.
+                    - Ensure the response remains clean and concise without extra explanations."
+                ],
+                ['role' => 'user', 'content' => "Here is the NLP result that needs formatting:\n\n$nlpResult"],
+            ],
+        ]);
+    
+        return trim($response['choices'][0]['message']['content'] ?? 'No response');
+    }
+
+    public function classifyMainGenerateText($prompt) {
+        $response = $this->client->chat()->create([
+            'model' => 'gpt-4o-mini',
+            'messages' => [
+                [
+                    'role' => 'system',
+                    'content' => "You are an assistant that classifies text into one of the following categories:
+                    - reklame (ads or product/service promotions)
+                    - business_or_industries (business or industries in general)
+                    - customers (customers, consumers, or service users)
+                    - pbg (tasks related to Building Approval)
+                    - retribusi (retributions related to PBG)
+                    - spatial_plannings (spatial planning)
+                    - tourisms (tourism and tourist destinations)
+                    - umkms (Micro, Small, and Medium Enterprises)
+    
+                    Respond with only one of the categories above without any additional explanation."
+                ],
+                [
+                    'role' => 'user',
+                    'content' => "Classify the following text:\n\n" . $prompt
+                ],
+            ],
+        ]);
+    
+        return trim($response['choices'][0]['message']['content'] ?? 'No response');
+    }
+
+    public function createMainQuery($classify, $prompt, $chatHistory)
+    {
+        // Load file JSON
+        $jsonPath = public_path('templates/table_config.json');
+        $jsonConfig = json_decode(file_get_contents($jsonPath), true);
+
+        // Pastikan kategori tersedia dalam konfigurasi
+        if (!isset($jsonConfig[$classify])) {
+            return "Error: Kategori tidak ditemukan dalam konfigurasi.";
+        }
+
+        // Ambil nama tabel dan kolom
+        $tableName = $jsonConfig[$classify]['table_name'];
+        $columns = implode(', ', $jsonConfig[$classify]['list_column']);
+
+        // Konversi chatHistory ke dalam format messages
+        $messages = [
+            [
+                'role' => 'system',
+                'content' => "You are an AI assistant that generates only valid MariaDB queries based on user requests. 
+                Use the following table information to construct the SQL query:
+
+                - Table Name: $tableName
+                - Available Columns: $columns
+
+                Generate only the SQL query without any explanation or additional text.
+                The query should include `LIMIT 10` to restrict the results."
+            ]
+        ];
+
+        // Menambahkan chat history sebagai konteks
+        foreach ($chatHistory as $chat) {
+            if (isset($chat['user'])) {
+                $messages[] = ['role' => 'user', 'content' => $chat['user']];
+            }
+            if (isset($chat['rawBotResponse'])) {
+                $messages[] = ['role' => 'assistant', 'content' => $chat['rawBotResponse']];
+            }
+        }
+
+        // Tambahkan prompt utama pengguna
+        $messages[] = ['role' => 'user', 'content' => $prompt];
+
+        // Kirim permintaan ke model AI
+        $response = $this->client->chat()->create([
+            'model' => 'gpt-4o-mini',
+            'messages' => $messages
+        ]);
+
+        return trim($response['choices'][0]['message']['content'] ?? 'No response');
+    }
+
+    
+    // public function createMainQuery($classify, $prompt)
+    // {
+    //     // Load file JSON
+    //     $jsonPath = public_path('templates/table_config.json');
+    //     $jsonConfig = json_decode(file_get_contents($jsonPath), true);
+
+    //     // Pastikan kategori tersedia dalam konfigurasi
+    //     if (!isset($jsonConfig[$classify])) {
+    //         return "Error: Kategori tidak ditemukan dalam konfigurasi.";
+    //     }
+
+    //     // Ambil nama tabel dan kolom
+    //     $tableName = $jsonConfig[$classify]['table_name'];
+    //     $columns = implode(', ', $jsonConfig[$classify]['list_column']);
+
+    //     $response = $this->client->chat()->create([
+    //         'model' => 'gpt-4o-mini',
+    //         'messages' => [
+    //             [
+    //                 'role' => 'system',
+    //                 'content' => "You are an AI assistant that generates only valid MariaDB queries based on user requests. 
+    //                 Use the following table information to construct the SQL query:
+
+    //                 - Table Name: $tableName
+    //                 - Available Columns: $columns
+
+    //                 Generate only the SQL query without any explanation or additional text
+    //                 The query should include `LIMIT 10` to restrict the results."
+    //             ],
+    //             [
+    //                 'role' => 'user',
+    //                 'content' => $prompt
+    //             ],
+    //         ],
+    //     ]);
+    
+    //     return trim($response['choices'][0]['message']['content'] ?? 'No response');
+    // }
+}

app/Services/ServiceClient.php

@@ -51,10 +51,26 @@ class ServiceClient
 
             $resultResponse = json_decode($responseBody, true, 512, JSON_THROW_ON_ERROR);
             return $this->resSuccess($resultResponse);
-        } catch (Exception $e) {
+            } catch (\GuzzleHttp\Exception\ClientException $e) {
-            \Log::error('error from client service'. $e->getMessage());
+                // Handle 4xx errors (e.g., 401 Unauthorized)
-            return $this->resError($e->getMessage());
+                $responseBody = (string) $e->getResponse()->getBody();
-        }
+                $errorResponse = json_decode($responseBody, true);
+
+                if (isset($errorResponse['code']) && $errorResponse['code'] === 'token_not_valid') {
+                    return $this->resError('Invalid token, please refresh your token.', $errorResponse, 401);
+                }
+
+                return $this->resError('Client error from API', $errorResponse, $e->getResponse()->getStatusCode());
+            } catch (\GuzzleHttp\Exception\ServerException $e) {
+                // Handle 5xx errors (e.g., Internal Server Error)
+                return $this->resError('Server error from API', (string) $e->getResponse()->getBody(), 500);
+            } catch (\GuzzleHttp\Exception\RequestException $e) {
+                // Handle network errors (e.g., timeout, connection issues)
+                return $this->resError('Network error: ' . $e->getMessage(), null, 503);
+            } catch (Exception $e) {
+                // Handle unexpected errors
+                return $this->resError('Unexpected error: ' . $e->getMessage(), null, 500);
+            }
     }
 
     // Fungsi untuk melakukan permintaan GET

app/Services/ServiceGoogleSheet.php

@@ -0,0 +1,280 @@
+<?php
+
+namespace App\Services;
+use App\Models\DataSetting;
+use App\Models\ImportDatasource;
+use App\Models\PbgTaskGoogleSheet;
+use Carbon\Carbon;
+use Exception;
+use Google_Client;
+use Google_Service_Sheets;
+use Log;
+class ServiceGoogleSheet
+{
+    protected $client;
+    protected $service;
+    protected $spreadsheetID;
+    protected $service_sheets;
+    protected $import_datasource;
+    public function __construct()
+    {
+        $this->client = new Google_Client();
+        $this->client->setApplicationName("Sibedas Google Sheets API");
+        $this->client->setScopes([Google_Service_Sheets::SPREADSHEETS_READONLY]);
+        $this->client->setAuthConfig(storage_path("app/teak-banner-450003-s8-ea05661d9db0.json"));
+        $this->client->setAccessType("offline");
+
+        $this->service = new Google_Service_Sheets($this->client);
+        $this->spreadsheetID = env("SPREAD_SHEET_ID");
+
+        $this->service_sheets = new Google_Service_Sheets($this->client);
+    }
+
+    public function run_service(){
+        try{
+            $this->sync_big_data();
+            $this->sync_google_sheet_data();
+        }catch(Exception $e){
+            throw $e;
+        }
+    }
+    public function sync_google_sheet_data() {
+        try {
+            $sheet_data = $this->get_data_by_sheet(0);
+
+            if (empty($sheet_data) || count($sheet_data) < 2) {
+                Log::warning("sync_google_sheet_data: No valid data found.");
+                throw new \Exception("sync_google_sheet_data: No valid data found.");
+            }
+
+            $cleanValue = function ($value) {
+                return (isset($value) && trim($value) !== '') ? trim($value) : null;
+            };
+
+            $mapUpsert = [];
+            foreach(array_slice($sheet_data, 1) as $row){
+                if(!is_array($row)){
+                    continue;
+                }
+
+                $no_registrasi = $cleanValue($row[2] ?? null);
+
+                // Apply the same logic from your SQL UPDATE
+                if (strpos($no_registrasi, 'PBG-') === 0) {
+                    $format_registrasi = $no_registrasi;
+                } else {
+                    $format_registrasi = sprintf(
+                        "PBG-%s-%s-%s",
+                        substr($no_registrasi, 0, 6) ?: '',
+                        substr($no_registrasi, 7, 8) ?: '',
+                        substr($no_registrasi, -2) ?: ''
+                    );
+                }
+
+                $mapUpsert[] = [
+                    'jenis_konsultasi' => $cleanValue($row[1] ?? null),
+                    'no_registrasi' => $no_registrasi,
+                    'formatted_registration_number' => $format_registrasi,
+                    'nama_pemilik' => $cleanValue($row[3] ?? null),
+                    'lokasi_bg' => $cleanValue($row[4] ?? null),
+                    'fungsi_bg' => $cleanValue($row[5] ?? null),
+                    'nama_bangunan' => $cleanValue($row[6] ?? null),
+                    'tgl_permohonan' => $this->convertToDate($cleanValue($row[7] ?? null)),
+                    'status_verifikasi' => $cleanValue($row[8] ?? null),
+                    'status_permohonan' => $cleanValue($row[9] ?? null),
+                    'alamat_pemilik' => $cleanValue($row[10] ?? null),
+                    'no_hp' => $cleanValue($row[11] ?? null),
+                    'email' => $cleanValue($row[12] ?? null),
+                    'tanggal_catatan' => $this->convertToDate($cleanValue($row[13] ?? null)),
+                    'catatan_kekurangan_dokumen' => $cleanValue($row[14] ?? null),
+                    'gambar' => $cleanValue($row[15] ?? null),
+                    'krk_kkpr' => $cleanValue($row[16] ?? null),
+                    'no_krk' => $cleanValue($row[17] ?? null),
+                    'lh' => $cleanValue($row[18] ?? null),
+                    'ska' => $cleanValue($row[19] ?? null),
+                    'keterangan' => $cleanValue($row[20] ?? null),
+                    'helpdesk' => $cleanValue($row[21] ?? null),
+                    'pj' => $cleanValue($row[22] ?? null),
+                    'kepemilikan' => $cleanValue($row[24] ?? null),
+                    'potensi_taru' => $cleanValue($row[25] ?? null),
+                    'validasi_dinas' => $cleanValue($row[26] ?? null),
+                    'kategori_retribusi' => $cleanValue($row[27] ?? null),
+                    'no_urut_ba_tpt' => $cleanValue($row[28] ?? null),
+                    'tanggal_ba_tpt' => $this->convertToDate($cleanValue($row[29] ?? null)),
+                    'no_urut_ba_tpa' => $cleanValue($row[30] ?? null),
+                    'tanggal_ba_tpa' => $this->convertToDate($cleanValue($row[31] ?? null)),
+                    'no_urut_skrd' => $cleanValue($row[32] ?? null),
+                    'tanggal_skrd' => $this->convertToDate($cleanValue($row[33] ?? null)),
+                    'ptsp' => $cleanValue($row[34] ?? null),
+                    'selesai_terbit' => $cleanValue($row[35] ?? null),
+                    'tanggal_pembayaran' => $cleanValue($row[36] ?? null),
+                    'format_sts' => $cleanValue($row[37] ?? null),
+                    'tahun_terbit' => (int) $cleanValue($row[38] ?? null),
+                    'tahun_berjalan' => (int) $cleanValue($row[39] ?? null),
+                    'kelurahan' => $cleanValue($row[40] ?? null),
+                    'kecamatan' => $cleanValue($row[41] ?? null),
+                    'lb' => $this->convertToDecimal($cleanValue($row[42] ?? 0)),
+                    'tb' => $this->convertToDecimal($cleanValue($row[43] ?? 0)),
+                    'jlb' => (int) $cleanValue($row[44] ?? null),
+                    'unit' => (int) $cleanValue($row[45] ?? null),
+                    'usulan_retribusi' => (int) $cleanValue($row[46] ?? null),
+                    'nilai_retribusi_keseluruhan_simbg' => $this->convertToDecimal($cleanValue($row[47] ?? 0)),
+                    'nilai_retribusi_keseluruhan_pad' => $this->convertToDecimal($cleanValue($row[48] ?? 0)),
+                    'denda' => $this->convertToDecimal($cleanValue($row[49] ?? 0)),
+                    'latitude' => $cleanValue($row[50] ?? null),
+                    'longitude' => $cleanValue($row[51] ?? null),
+                    'nik_nib' => $cleanValue($row[52] ?? null),
+                    'dok_tanah' => $cleanValue($row[53] ?? null),
+                    'temuan' => $cleanValue($row[54] ?? null),
+                    'updated_at' => now()
+                ];
+            }
+
+            // Count occurrences of each no_registrasi
+            $registrasiCounts = array_count_values(array_column($mapUpsert, 'no_registrasi'));
+
+            // Filter duplicates (those appearing more than once)
+            $duplicates = array_filter($registrasiCounts, function ($count) {
+                return $count > 1;
+            });
+
+            if (!empty($duplicates)) {
+                Log::warning("Duplicate no_registrasi found", ['duplicates' => array_keys($duplicates)]);
+            }
+
+            // Remove duplicates before upsert
+            $mapUpsert = collect($mapUpsert)->unique('no_registrasi')->values()->all();
+
+            $batchSize = 1000;
+            $chunks = array_chunk($mapUpsert, $batchSize);
+            foreach ($chunks as $chunk) {
+                PbgTaskGoogleSheet::upsert($chunk, ['no_registrasi']);
+            }
+
+            Log::info("sync google sheet done");
+            return true;
+        } catch (\Exception $e) {
+            Log::error("sync_google_sheet_data failed", ['error' => $e->getMessage()]);
+            throw $e;
+        }
+    }
+
+
+    public function sync_big_data(){
+        try {
+            $sheet_big_data = $this->get_data_by_sheet();
+            $data_setting_result = []; // Initialize result storage
+
+            $found_section = null; // Track which section is found
+
+            foreach ($sheet_big_data as $row) {
+                // Check for section headers
+                if (in_array("•PROSES PENERBITAN:", $row)) {
+                    $found_section = "MENUNGGU_KLIK_DPMPTSP";
+                } elseif (in_array("•BERKAS AKTUAL TERVERIFIKASI DINAS TEKNIS 2024:", $row)) {
+                    $found_section = "REALISASI_TERBIT_PBG";
+                } elseif (in_array("•TERPROSES DI DPUTR: belum selesai rekomtek'", $row)) {
+                    $found_section = "PROSES_DINAS_TEKNIS";
+                }
+
+                // If a section is found and we reach "Grand Total", save the corresponding values
+                if ($found_section && isset($row[0]) && trim($row[0]) === "Grand Total") {
+                    if ($found_section === "MENUNGGU_KLIK_DPMPTSP") {
+                        $data_setting_result["MENUNGGU_KLIK_DPMPTSP_COUNT"] = $this->convertToInteger($row[2]) ?? null;
+                        $data_setting_result["MENUNGGU_KLIK_DPMPTSP_SUM"] = $this->convertToDecimal($row[3])  ?? null;
+                    } elseif ($found_section === "REALISASI_TERBIT_PBG") {
+                        $data_setting_result["REALISASI_TERBIT_PBG_COUNT"] = $this->convertToInteger($row[2]) ?? null;
+                        $data_setting_result["REALISASI_TERBIT_PBG_SUM"] = $this->convertToDecimal($row[4]) ?? null;
+                    } elseif ($found_section === "PROSES_DINAS_TEKNIS") {
+                        $data_setting_result["PROSES_DINAS_TEKNIS_COUNT"] = $this->convertToInteger($row[2]) ?? null;
+                        $data_setting_result["PROSES_DINAS_TEKNIS_SUM"] = $this->convertToDecimal($row[3]) ?? null;
+                    }
+
+                    // Reset section tracking after capturing "Grand Total"
+                    $found_section = null;
+                }
+            }
+
+            foreach ($data_setting_result as $key => $value) {
+                DataSetting::updateOrInsert(
+                    ["key" => $key], // Find by key
+                    ["value" => $value] // Update or insert value
+                );
+            }
+
+            return true;
+        } catch (\Exception $e) {
+            // **Log error**
+            Log::error("Error syncing Google Sheet data", ['error' => $e->getMessage()]);
+            return false;
+        }
+    }
+
+    private function get_data_by_sheet($no_sheet = 1){
+        $spreadsheet = $this->service->spreadsheets->get($this->spreadsheetID);
+        $sheets = $spreadsheet->getSheets();
+        $sheetTitle = $sheets[$no_sheet]->getProperties()->getTitle();
+        $range = "{$sheetTitle}";
+        $response = $this->service->spreadsheets_values->get($this->spreadsheetID, $range);
+        $values = $response->getValues();
+        return!empty($values)? $values : [];
+    }
+
+    private function convertToInteger($value) {
+        // Check if the value is an empty string, and return null if true
+        if (trim($value) === "") {
+            return null;
+        }
+
+        $cleaned = str_replace('.','', $value);
+
+        // Otherwise, cast to integer
+        return (int) $cleaned;
+    }
+
+    private function convertToDecimal(?string $value): ?float
+    {
+        if (empty($value)) {
+            return null; // Return null if the input is empty
+        }
+
+        // Remove all non-numeric characters except comma and dot
+        $value = preg_replace('/[^0-9,\.]/', '', $value);
+
+        // If the number contains both dot (.) and comma (,)
+        if (strpos($value, '.') !== false && strpos($value, ',') !== false) {
+            $value = str_replace('.', '', $value); // Remove thousands separator
+            $value = str_replace(',', '.', $value); // Convert decimal separator to dot
+        }
+        // If only a dot is present (assumed as thousands separator)
+        elseif (strpos($value, '.') !== false) {
+            $value = str_replace('.', '', $value); // Remove all dots (treat as thousands separators)
+        }
+        // If only a comma is present (assumed as decimal separator)
+        elseif (strpos($value, ',') !== false) {
+            $value = str_replace(',', '.', $value); // Convert comma to dot (decimal separator)
+        }
+
+        // Ensure the value is numeric before returning
+        return is_numeric($value) ? (float) number_format((float) $value, 2, '.', '') : null;
+    }
+
+    private function convertToDate($dateString)
+    {
+        try {
+            // Check if the string is empty
+            if (empty($dateString)) {
+                return null;
+            }
+
+            // Try to parse the date string
+            $date = Carbon::parse($dateString);
+
+            // Return the Carbon instance
+            return $date->format('Y-m-d');
+        } catch (\Exception $e) {
+            // Return null if an error occurs during parsing
+            return null;
+        }
+    }
+}

app/Services/ServicePbgTask.php

@@ -0,0 +1,173 @@
+<?php
+
+namespace App\Services;
+
+use App\Models\GlobalSetting;
+use App\Models\PbgTask;
+use Carbon\Carbon;
+use GuzzleHttp\Client;
+use Exception;
+use Illuminate\Support\Facades\Log;
+
+class ServicePbgTask
+{
+    private $client;
+    private $simbg_host;
+    private $fetch_per_page;
+    private $pbg_task_url;
+    private $service_token;
+    private $user_token;
+    private $user_refresh_token;
+
+    public function __construct(Client $client, ServiceTokenSIMBG $service_token)
+    {
+        $settings = GlobalSetting::whereIn('key', ['SIMBG_HOST', 'FETCH_PER_PAGE'])
+            ->pluck('value', 'key');
+
+        $this->simbg_host = trim((string) ($settings['SIMBG_HOST'] ?? ""));
+        $this->fetch_per_page = trim((string) ($settings['FETCH_PER_PAGE'] ?? "10"));
+        $this->client = $client;
+        $this->service_token = $service_token;
+        $this->pbg_task_url = "{$this->simbg_host}/api/pbg/v1/list/?page=1&size={$this->fetch_per_page}&sort=ASC";
+        $auth_data = $this->service_token->get_token();
+        $this->user_token = $auth_data['access'];
+        $this->user_refresh_token = $auth_data['refresh'];
+    }
+
+    public function run_service()
+    {
+        try{
+            $this->fetch_pbg_task();
+        }catch(Exception $e){
+            throw $e;
+        }
+    }
+
+    private function fetch_pbg_task()
+    {
+        try {
+            $currentPage = 1;
+            $totalPage = 1;
+
+            $options = [
+                'headers' => [
+                    'Authorization' => "Bearer {$this->user_token}",
+                    'Content-Type' => 'application/json'
+                ]
+            ];
+
+            $maxRetries = 3; // Maximum number of retries
+            $initialDelay = 1; // Initial delay in seconds
+
+            $fetchData = function ($url) use (&$options, $maxRetries, $initialDelay) {
+                $retryCount = 0;
+
+                while ($retryCount < $maxRetries) {
+                    try {
+                        return $this->client->get($url, $options);
+                    } catch (\GuzzleHttp\Exception\ClientException $e) {
+                        if ($e->getCode() === 401) {
+                            Log::warning("Unauthorized. Refreshing token...");
+
+                            // Refresh token
+                            $auth_data = $this->service_token->refresh_token($this->user_refresh_token);
+                            if (!isset($auth_data['access'])) {
+                                Log::error("Token refresh failed.");
+                                throw new Exception("Token refresh failed.");
+                            }
+
+                            // Update tokens
+                            $this->user_token = $auth_data['access'];
+                            $this->user_refresh_token = $auth_data['refresh'];
+
+                            // Update headers
+                            $options['headers']['Authorization'] = "Bearer {$this->user_token}";
+
+                            // Retry request
+                            return $this->client->get($url, $options);
+                        }
+                        throw $e;
+                    } catch (\GuzzleHttp\Exception\ServerException | \GuzzleHttp\Exception\ConnectException $e) {
+                        // Handle 502 or connection issues
+                        if ($e->getCode() === 502) {
+                            Log::warning("502 Bad Gateway - Retrying in {$initialDelay} seconds...");
+                        } else {
+                            Log::error("Network error - Retrying in {$initialDelay} seconds...");
+                        }
+
+                        $retryCount++;
+                        sleep($initialDelay);
+                        $initialDelay *= 2; // Exponential backoff
+                    }
+                }
+
+                Log::error("Max retries reached. Failing request.");
+                throw new Exception("Max retries reached. Failing request.");
+            };
+
+            do {
+                $url = "{$this->simbg_host}/api/pbg/v1/list/?page={$currentPage}&size={$this->fetch_per_page}&sort=ASC";
+
+                $fetch_data = $fetchData($url);
+                if (!$fetch_data) {
+                    Log::error("Failed to fetch data on page {$currentPage} after retries.");
+                    throw new Exception("Failed to fetch data on page {$currentPage} after retries.");
+                }
+
+                $response = json_decode($fetch_data->getBody()->getContents(), true);
+                if (!isset($response['data'])) {
+                    Log::error("Invalid API response on page {$currentPage}");
+                    throw new Exception("Invalid API response on page {$currentPage}");
+                }
+
+                $data = $response['data'];
+                $totalPage = isset($response['total_page']) ? (int) $response['total_page'] : 1;
+
+                $saved_data = [];
+                foreach ($data as $item) {
+                    $saved_data[] = [
+                        'uuid' => $item['uid'] ?? null,
+                        'name' => $item['name'] ?? null,
+                        'owner_name' => $item['owner_name'] ?? null,
+                        'application_type' => $item['application_type'] ?? null,
+                        'application_type_name' => $item['application_type_name'] ?? null,
+                        'condition' => $item['condition'] ?? null,
+                        'registration_number' => $item['registration_number'] ?? null,
+                        'document_number' => $item['document_number'] ?? null,
+                        'address' => $item['address'] ?? null,
+                        'status' => $item['status'] ?? null,
+                        'status_name' => $item['status_name'] ?? null,
+                        'slf_status' => $item['slf_status'] ?? null,
+                        'slf_status_name' => $item['slf_status_name'] ?? null,
+                        'function_type' => $item['function_type'] ?? null,
+                        'consultation_type' => $item['consultation_type'] ?? null,
+                        'due_date' => $item['due_date'] ?? null,
+                        'land_certificate_phase' => $item['land_certificate_phase'] ?? null,
+                        'task_created_at' => isset($item['created_at']) ? Carbon::parse($item['created_at'])->format('Y-m-d H:i:s') : null,
+                        'updated_at' => now(),
+                        'created_at' => now(),
+                    ];
+                }
+
+                if (!empty($saved_data)) {
+                    PbgTask::upsert($saved_data, ['uuid'], [
+                        'name', 'owner_name', 'application_type', 'application_type_name', 'condition',
+                        'registration_number', 'document_number', 'address', 'status', 'status_name',
+                        'slf_status', 'slf_status_name', 'function_type', 'consultation_type', 'due_date',
+                        'land_certificate_phase', 'task_created_at', 'updated_at'
+                    ]);
+                }
+
+                Log::info("Page {$currentPage} fetched & saved", ['records' => count($saved_data)]);
+
+                $currentPage++;
+            } while ($currentPage <= $totalPage);
+
+            return true;
+        } catch (Exception $e) {
+            Log::error("Error fetching PBG tasks", ['error' => $e->getMessage()]);
+            throw $e;
+        }
+    }
+
+}

app/Services/ServiceSIMBG.php

@@ -9,12 +9,16 @@ use App\Models\ImportDatasource;
 use App\Models\PbgTaskIndexIntegrations;
 use App\Models\PbgTaskPrasarana;
 use App\Models\PbgTaskRetributions;
+use App\Models\TaskAssignment;
 use Exception;
 use App\Models\PbgTask;
 use App\Traits\GlobalApiResponse;
 use Illuminate\Support\Facades\Log;
 use Carbon\Carbon;
 use App\Services\ServiceClient;
+use App\Services\GoogleSheetService;
+use App\Models\DataSetting;
+use App\Models\PbgTaskGoogleSheet;
 
 class ServiceSIMBG
 {
@@ -24,10 +28,11 @@ class ServiceSIMBG
     private $simbg_host;
     private $fetch_per_page;
     private $service_client;
+    private $googleSheetService;
     /**
      * Create a new class instance.
      */
-    public function __construct()
+    public function __construct(GoogleSheetService $googleSheetService)
     {
         $settings = GlobalSetting::whereIn('key', [
             'SIMBG_EMAIL', 'SIMBG_PASSWORD', 'SIMBG_HOST', 'FETCH_PER_PAGE'
@@ -39,6 +44,7 @@ class ServiceSIMBG
         $this->fetch_per_page = trim((string) ($settings['FETCH_PER_PAGE'] ?? ""));
     
         $this->service_client = new ServiceClient($this->simbg_host);
+        $this->googleSheetService = $googleSheetService;
     }
 
     public function getToken(){
@@ -61,32 +67,44 @@ class ServiceSIMBG
         }
     }
 
-    public function syncIndexIntegration($uuid, $token)
+    public function syncIndexIntegration($uuids)
     {
         try{
-            $url = "/api/pbg/v1/detail/" . $uuid . "/retribution/indeks-terintegrasi/";
+            if(empty($uuids)){
-    
-            $headers = [
-                'Authorization' => "Bearer " . $token,
-            ];
-        
-            $res = $this->service_client->get($url, $headers);
-        
-            if (empty($res->original['success']) || !$res->original['success']) {
-                // Log error
-                Log::error("API response indicates failure", ['url' => $url, 'uuid' => $uuid]);
                 return false;
             }
-        
+
-            $data = $res->original['data']['data'] ?? null;
+            $initResToken = $this->getToken();
-            if (!$data) {
+            if (empty($initResToken->original['data']['token']['access'])) {
-                Log::error("No valid data returned from API", ['url' => $url, 'uuid' => $uuid]);
+                Log::error("API response indicates failure", ['token' => 'Failed to retrieve token']);
                 return false;
             }
+            $token = $initResToken->original['data']['token']['access'];
+            
+            $integrations = [];
+            foreach($uuids as $uuid){
+                $url = "/api/pbg/v1/detail/" . $uuid . "/retribution/indeks-terintegrasi/";
         
-            $resultData = PbgTaskIndexIntegrations::updateOrCreate(
+                $headers = [
-                ['pbg_task_uid' => $uuid],
+                    'Authorization' => "Bearer " . $token,
-                [
+                ];
+            
+                $res = $this->service_client->get($url, $headers);
+            
+                if (empty($res->original['success']) || !$res->original['success']) {
+                    // Log error
+                    Log::error("API response indicates failure", ['url' => $url, 'uuid' => $uuid]);
+                    continue;
+                }
+            
+                $data = $res->original['data']['data'] ?? null;
+                if (!$data) {
+                    Log::error("No valid data returned from API", ['url' => $url, 'uuid' => $uuid]);
+                    continue;
+                }
+
+                $integrations[] = [
+                    'pbg_task_uid' => $uuid,
                     'indeks_fungsi_bangunan' => $data['indeks_fungsi_bangunan'] ?? null,
                     'indeks_parameter_kompleksitas' => $data['indeks_parameter_kompleksitas'] ?? null,
                     'indeks_parameter_permanensi' => $data['indeks_parameter_permanensi'] ?? null,
@@ -94,8 +112,11 @@ class ServiceSIMBG
                     'faktor_kepemilikan' => $data['faktor_kepemilikan'] ?? null,
                     'indeks_terintegrasi' => $data['indeks_terintegrasi'] ?? null,
                     'total' => $data['total'] ?? null,
-                ]
+                ];
-            );
+            }
+
+            PbgTaskIndexIntegrations::upsert($integrations, ['pbg_task_uid'], ['indeks_fungsi_bangunan', 
+            'indeks_parameter_kompleksitas', 'indeks_parameter_permanensi', 'indeks_parameter_ketinggian', 'faktor_kepemilikan', 'indeks_terintegrasi', 'total']);
             
             return true;
         }catch (Exception $e){
@@ -104,151 +125,365 @@ class ServiceSIMBG
         }
     }
 
-    public function syncTaskList()
+    public function syncTaskPBG()
     {
-        $initResToken = $this->getToken();
+        try {
-
+            Log::info("Processing google sheet sync");
-        $importDatasource = ImportDatasource::create([
+            $importDatasource = ImportDatasource::create([
-            'status' => ImportDatasourceStatus::Processing->value,
+                'status' => ImportDatasourceStatus::Processing->value,
-        ]);
-
-        if (empty($initResToken->original['data']['token']['access'])) {
-            $importDatasource->update([
-                'status' => ImportDatasourceStatus::Failed->value,
-                'message' => 'Failed to retrieve token'
             ]);
-            return $this->resError("Failed to retrieve token");
-        }
 
-        $apiToken = $initResToken->original['data']['token']['access'];
+            // sync google sheet first
-        $headers = ['Authorization' => "Bearer " . $apiToken];
+            $totalRowCount = $this->googleSheetService->getLastRowByColumn("C");
-
+            $sheetData = $this->googleSheetService->getSheetDataCollection($totalRowCount);
-        $url = "/api/pbg/v1/list/?page=1&size={$this->fetch_per_page}&sort=ASC";
+            $sheet_big_data = $this->googleSheetService->get_data_by_sheet();
-        $initialResponse = $this->service_client->get($url, $headers);
+            $data_setting_result = []; // Initialize result storage
-
+        
-        $totalPage = $initialResponse->original['data']['total_page'] ?? 0;
+            $found_section = null; // Track which section is found
-        if ($totalPage == 0) {
+        
-            $importDatasource->update([
+            foreach ($sheet_big_data as $row) {
-                'status' => ImportDatasourceStatus::Failed->value,
+                // Check for section headers
-                'message' => 'Invalid response: no total_page'
+                if (in_array("•PROSES PENERBITAN:", $row)) {
-            ]);
+                    $found_section = "MENUNGGU_KLIK_DPMPTSP";
-            return $this->resError("Invalid response from API");
+                } elseif (in_array("•BERKAS AKTUAL TERVERIFIKASI DINAS TEKNIS 2024:", $row)) {
-        }
+                    $found_section = "REALISASI_TERBIT_PBG";
-
+                } elseif (in_array("•TERPROSES DI DPUTR: belum selesai rekomtek'", $row)) {
-        $savedCount = $failedCount = 0;
+                    $found_section = "PROSES_DINAS_TEKNIS";
-
+                }
-        for ($currentPage = 1; $currentPage <= $totalPage; $currentPage++) {
+        
-            $pageUrl = "/api/pbg/v1/list/?page={$currentPage}&size={$this->fetch_per_page}&sort=ASC";
+                // If a section is found and we reach "Grand Total", save the corresponding values
-            $getToken = $this->getToken();
+                if ($found_section && isset($row[0]) && trim($row[0]) === "Grand Total") {
-            Log::info("response index integration", ['currentPage' => $currentPage]);
+                    if ($found_section === "MENUNGGU_KLIK_DPMPTSP") {
-            if (empty($getToken->original['data']['token']['access'])) {
+                        $data_setting_result["MENUNGGU_KLIK_DPMPTSP_COUNT"] = $this->convertToInteger($row[2]) ?? null;
-                $importDatasource->update([
+                        $data_setting_result["MENUNGGU_KLIK_DPMPTSP_SUM"] = $this->convertToDecimal($row[3])  ?? null;
-                    'status' => ImportDatasourceStatus::Failed->value,
+                    } elseif ($found_section === "REALISASI_TERBIT_PBG") {
-                    'message' => 'Failed to retrieve token'
+                        $data_setting_result["REALISASI_TERBIT_PBG_COUNT"] = $this->convertToInteger($row[2]) ?? null;
-                ]);
+                        $data_setting_result["REALISASI_TERBIT_PBG_SUM"] = $this->convertToDecimal($row[4]) ?? null;
-                break;
+                    } elseif ($found_section === "PROSES_DINAS_TEKNIS") {
-            }
+                        $data_setting_result["PROSES_DINAS_TEKNIS_COUNT"] = $this->convertToInteger($row[2]) ?? null;
-            $token = $getToken->original['data']['token']['access'];
+                        $data_setting_result["PROSES_DINAS_TEKNIS_SUM"] = $this->convertToDecimal($row[3]) ?? null;
-            $headers = ['Authorization' => "Bearer " . $token];
+                    }
-            $response = $this->service_client->get($pageUrl, $headers);
+        
-            $tasks = $response->original['data']['data'] ?? [];
+                    // Reset section tracking after capturing "Grand Total"
-
+                    $found_section = null;
-            if (empty($tasks)) {
-                $importDatasource->update([
-                    'status' => ImportDatasourceStatus::Failed->value,
-                    'message' => 'No data found on page'
-                ]);
-                Log::warning("No data found on page", ['page' => $currentPage]);
-                break;
-            }
-
-            Log::info("executed page", ['page' => $currentPage, 'total' => $totalPage]);
-
-            $tasksCollective = [];
-            foreach ($tasks as $item) {
-                try {
-                    $tasksCollective[] = [
-                        'uuid' => $item['uid'],
-                        'name' => $item['name'],
-                        'owner_name' => $item['owner_name'],
-                        'application_type' => $item['application_type'],
-                        'application_type_name' => $item['application_type_name'],
-                        'condition' => $item['condition'],
-                        'registration_number' => $item['registration_number'],
-                        'document_number' => $item['document_number'],
-                        'address' => $item['address'],
-                        'status' => $item['status'],
-                        'status_name' => $item['status_name'],
-                        'slf_status' => $item['slf_status'] ?? null,
-                        'slf_status_name' => $item['slf_status_name'] ?? null,
-                        'function_type' => $item['function_type'],
-                        'consultation_type' => $item['consultation_type'],
-                        'due_date' => $item['due_date'],
-                        'land_certificate_phase' => $item['land_certificate_phase'],
-                        'task_created_at' => isset($item['created_at']) ? Carbon::parse($item['created_at'])->format('Y-m-d H:i:s') : null,
-                        'updated_at' => now(),
-                        'created_at' => now(),
-                    ];
-
-                    $this->syncIndexIntegration($item['uid'], $token);
-
-                    $this->syncTaskDetailSubmit($item['uid'], $token);
-                    
-                    $savedCount++;
-                } catch (Exception $e) {
-                    $failedCount++;
-                    $importDatasource->update([
-                        'status' => ImportDatasourceStatus::Failed->value,
-                        'message' => "Successfully processed: $savedCount, Failed: $failedCount"
-                    ]);
-                    Log::error("Failed to process task", [
-                        'error' => $e->getMessage(),
-                        'task' => $item,
-                    ]);
-                    break;
                 }
             }
 
-            PbgTask::upsert($tasksCollective, ['uuid'], [
+            Log::info("data setting result", ['result' => $data_setting_result]);
-                'name', 'owner_name', 'application_type', 'application_type_name', 'condition',
+
-                'registration_number', 'document_number', 'address', 'status', 'status_name',
+            foreach ($data_setting_result as $key => $value) {
-                'slf_status', 'slf_status_name', 'function_type', 'consultation_type', 'due_date',
+                DataSetting::updateOrInsert(
-                'land_certificate_phase', 'task_created_at', 'updated_at'
+                    ["key" => $key], // Find by key
+                    ["value" => $value] // Update or insert value
+                );
+            }
+            $mapToUpsert = [];
+
+            foreach ($sheetData as $data) {
+                $mapToUpsert[] = [
+                    'no_registrasi' => $this->cleanString($data['no__registrasi'] ?? null),
+                    'jenis_konsultasi' => $this->cleanString($data['jenis_konsultasi'] ?? null),
+                    'fungsi_bg' => $this->cleanString($data['fungsi_bg'] ?? null),
+                    'tgl_permohonan' => $this->convertToDate($this->cleanString($data['tgl_permohonan'] ?? null)),
+                    'status_verifikasi' => $this->cleanString($data['status_verifikasi'] ?? null),
+                    'status_permohonan' => $this->convertToDate($this->cleanString($data['status_permohonan'] ?? null)),
+                    'alamat_pemilik' => $this->cleanString($data['alamat_pemilik'] ?? null),
+                    'no_hp' => $this->cleanString($data['no__hp'] ?? null),
+                    'email' => $this->cleanString($data['e_mail'] ?? null),
+                    'tanggal_catatan' => $this->convertToDate($this->cleanString($data['tanggal_catatan'] ?? null)),
+                    'catatan_kekurangan_dokumen' => $this->cleanString($data['catatan_kekurangan_dokumen'] ?? null),
+                    'gambar' => $this->cleanString($data['gambar'] ?? null),
+                    'krk_kkpr' => $this->cleanString($data['krk_kkpr'] ?? null),
+                    'no_krk' => $this->cleanString($data['no__krk'] ?? null),
+                    'lh' => $this->cleanString($data['lh'] ?? null),
+                    'ska' => $this->cleanString($data['ska'] ?? null),
+                    'keterangan' => $this->cleanString($data['keterangan'] ?? null),
+                    'helpdesk' => $this->cleanString($data['helpdesk'] ?? null),
+                    'pj' => $this->cleanString($data['pj'] ?? null),
+                    'kepemilikan' => $this->cleanString($data['kepemilikan'] ?? null),
+                    'potensi_taru' => $this->cleanString($data['potensi_taru'] ?? null),
+                    'validasi_dinas' => $this->cleanString($data['validasi_dinas'] ?? null),
+                    'kategori_retribusi' => $this->cleanString($data['kategori_retribusi'] ?? null),
+                    'no_urut_ba_tpt' => $this->cleanString($data['no__urut_ba_tpt__2024_0001_'] ?? null),
+                    'tanggal_ba_tpt' => $this->convertToDate($this->cleanString($data['tanggal_ba_tpt'] ?? null)),
+                    'no_urut_ba_tpa' => $this->cleanString($data['no__urut_ba_tpa'] ?? null),
+                    'tanggal_ba_tpa' => $this->convertToDate($this->cleanString($data['tanggal_ba_tpa'] ?? null)),
+                    'no_urut_skrd' => $this->cleanString($data['no__urut_skrd__2024_0001_'] ?? null),
+                    'tanggal_skrd' => $this->convertToDate($this->cleanString($data['tanggal_skrd'] ?? null)),
+                    'ptsp' => $this->cleanString($data['ptsp'] ?? null),
+                    'selesai_terbit' => $this->cleanString($data['selesai_terbit'] ?? null),
+                    'tanggal_pembayaran' => $this->convertToDate($this->cleanString($data['tanggal_pembayaran__yyyy_mm_dd_'] ?? null)),
+                    'format_sts' => $this->cleanString($data['format_sts'] ?? null),
+                    'tahun_terbit' => (int) ($data['tahun_terbit'] ?? null),
+                    'tahun_berjalan' => (int) ($data['tahun_berjalan'] ?? null),
+                    'kelurahan' => $this->cleanString($data['kelurahan'] ?? null),
+                    'kecamatan' => $this->cleanString($data['kecamatan'] ?? null),
+                    'lb' => $this->convertToDecimal($data['lb'] ?? null),
+                    'tb' => $this->convertToDecimal($data['tb'] ?? null),
+                    'jlb' => (int) ($data['jlb'] ?? null),
+                    'unit' => (int) ($data['unit'] ?? null),
+                    'usulan_retribusi' => (int) ($data['usulan_retribusi'] ?? null),
+                    'nilai_retribusi_keseluruhan_simbg' => $this->convertToDecimal($data['nilai_retribusi_keseluruhan__simbg_'] ?? null),
+                    'nilai_retribusi_keseluruhan_pad' => $this->convertToDecimal($data['nilai_retribusi_keseluruhan__pad_'] ?? null),
+                    'denda' => $this->convertToDecimal($data['denda'] ?? null),
+                    'latitude' => $this->cleanString($data['latitude'] ?? null),
+                    'longitude' => $this->cleanString($data['longitude'] ?? null),
+                    'nik_nib' => $this->cleanString($data['nik_nib'] ?? null),
+                    'dok_tanah' => $this->cleanString($data['dok__tanah'] ?? null),
+                    'temuan' => $this->cleanString($data['temuan'] ?? null),
+                ];
+            }
+
+            $batchSize = 1000;
+            $chunks = array_chunk($mapToUpsert, $batchSize);
+
+            foreach($chunks as $chunk){
+                PbgTaskGoogleSheet::upsert($chunk, ["no_registrasi"],[
+                    'jenis_konsultasi',
+                    'nama_pemilik',
+                    'lokasi_bg',
+                    'fungsi_bg',
+                    'nama_bangunan',
+                    'tgl_permohonan',
+                    'status_verifikasi',
+                    'status_permohonan',
+                    'alamat_pemilik',
+                    'no_hp',
+                    'email',
+                    'tanggal_catatan',
+                    'catatan_kekurangan_dokumen',
+                    'gambar',
+                    'krk_kkpr',
+                    'no_krk',
+                    'lh',
+                    'ska',
+                    'keterangan',
+                    'helpdesk',
+                    'pj',
+                    'kepemilikan',
+                    'potensi_taru',
+                    'validasi_dinas',
+                    'kategori_retribusi',
+                    'no_urut_ba_tpt',
+                    'tanggal_ba_tpt',
+                    'no_urut_ba_tpa',
+                    'tanggal_ba_tpa',
+                    'no_urut_skrd',
+                    'tanggal_skrd',
+                    'ptsp',
+                    'selesai_terbit',
+                    'tanggal_pembayaran',
+                    'format_sts',
+                    'tahun_terbit',
+                    'tahun_berjalan',
+                    'kelurahan',
+                    'kecamatan',
+                    'lb',
+                    'tb',
+                    'jlb',
+                    'unit',
+                    'usulan_retribusi',
+                    'nilai_retribusi_keseluruhan_simbg',
+                    'nilai_retribusi_keseluruhan_pad',
+                    'denda',
+                    'latitude',
+                    'longitude',
+                    'nik_nib',
+                    'dok_tanah',
+                    'temuan',
+                ]);
+            }
+            
+            $initResToken = $this->getToken();
+            if (empty($initResToken->original['data']['token']['access'])) {
+                $importDatasource->update([
+                    'status' => ImportDatasourceStatus::Failed->value,
+                    'response_body' => 'Failed to retrieve token'
+                ]);
+                return $this->resError("Failed to retrieve token");
+            }
+            $apiToken = $initResToken->original['data']['token']['access'];
+            $headers = ['Authorization' => "Bearer " . $apiToken];
+
+            $url = "/api/pbg/v1/list/?page=1&size={$this->fetch_per_page}&sort=ASC";
+            $initialResponse = $this->service_client->get($url, $headers);
+
+            $totalPage = $initialResponse->original['data']['total_page'] ?? 0;
+            if ($totalPage == 0) {
+                $importDatasource->update([
+                    'status' => ImportDatasourceStatus::Failed->value,
+                    'response_body' => 'Invalid response: no total_page'
+                ]);
+                return $this->resError("Invalid response from API");
+            }
+
+            $savedCount = $failedCount = 0;
+
+            Log::info("Fetching tasks", ['total page' => $totalPage]);
+
+            for ($currentPage = 1; $currentPage <= $totalPage; $currentPage++) {
+                try {
+                    $pageUrl = "/api/pbg/v1/list/?page={$currentPage}&size={$this->fetch_per_page}&sort=ASC";
+
+                    Log::info("Fetching tasks", ['currentPage' => $currentPage]);
+                    $headers = [
+                        'Authorization' => "Bearer " . $apiToken, // Update headers
+                    ];
+
+                    for ($attempt = 0; $attempt < 2; $attempt++) { // Try twice (original + retry)
+
+                        $response = $this->service_client->get($pageUrl, $headers);
+
+                        if ($response instanceof \Illuminate\Http\JsonResponse) {
+                            $decodedResponse = json_decode($response->getContent(), true);
+
+                            if (isset($decodedResponse['errors']['code']) && $decodedResponse['errors']['code'] === 'token_not_valid') {
+                                $initResToken = $this->getToken();
+
+                                if (!empty($initResToken->original['data']['token']['access'])) {
+                                    $new_token = $initResToken->original['data']['token']['access'];
+                                    $headers['Authorization'] = "Bearer " . $new_token;
+                                    continue;
+                                } else {
+                                    Log::error("Failed to refresh token");
+                                    return $this->resError("Failed to refresh token");
+                                }
+                            }
+                        }
+
+                        // Success case, break loop
+                        break;
+                    }
+
+                    $tasks = $response->original['data']['data'] ?? [];
+
+                    if (empty($tasks)) {
+                        Log::warning("No data found on page", ['page' => $currentPage]);
+                        continue;
+                    }
+
+                    $tasksCollective = [];
+                    foreach ($tasks as $item) {
+                        try {
+                            $tasksCollective[] = [
+                                'uuid' => $item['uid'],
+                                'name' => $item['name'],
+                                'owner_name' => $item['owner_name'],
+                                'application_type' => $item['application_type'],
+                                'application_type_name' => $item['application_type_name'],
+                                'condition' => $item['condition'],
+                                'registration_number' => $item['registration_number'],
+                                'document_number' => $item['document_number'],
+                                'address' => $item['address'],
+                                'status' => $item['status'],
+                                'status_name' => $item['status_name'],
+                                'slf_status' => $item['slf_status'] ?? null,
+                                'slf_status_name' => $item['slf_status_name'] ?? null,
+                                'function_type' => $item['function_type'],
+                                'consultation_type' => $item['consultation_type'],
+                                'due_date' => $item['due_date'],
+                                'land_certificate_phase' => $item['land_certificate_phase'],
+                                'task_created_at' => isset($item['created_at']) ? Carbon::parse($item['created_at'])->format('Y-m-d H:i:s') : null,
+                                'updated_at' => now(),
+                                'created_at' => now(),
+                            ];
+
+                            $this->syncTaskDetailSubmit($item['uid'], $apiToken);
+                            $this->syncTaskAssignments($item['uid']);
+                            $savedCount++;
+                        } catch (Exception $e) {
+                            $failedCount++;
+                            Log::error("Failed to process task", [
+                                'error' => $e->getMessage(),
+                                'task' => $item,
+                            ]);
+                            continue; // Skip failed task, continue processing the rest
+                        }
+                    }
+
+                    if (!empty($tasksCollective)) {
+                        PbgTask::upsert($tasksCollective, ['uuid'], [
+                            'name', 'owner_name', 'application_type', 'application_type_name', 'condition',
+                            'registration_number', 'document_number', 'address', 'status', 'status_name',
+                            'slf_status', 'slf_status_name', 'function_type', 'consultation_type', 'due_date',
+                            'land_certificate_phase', 'task_created_at', 'updated_at'
+                        ]);
+
+                        $uuids = array_column($tasksCollective, 'uuid');
+                        $this->syncIndexIntegration($uuids);
+                    }
+                } catch (Exception $e) {
+                    Log::error("Failed to process page", [
+                        'error' => $e->getMessage(),
+                        'page' => $currentPage,
+                    ]);
+                    continue; // Skip the failed page and move to the next
+                }
+            }
+
+            BigdataResume::generateResumeData($importDatasource->id, "all", $data_setting_result);
+            BigdataResume::generateResumeData($importDatasource->id, now()->year, $data_setting_result);
+
+            // Final update after processing all pages
+            $importDatasource->update([
+                'status' => ImportDatasourceStatus::Success->value,
+                'message' => "Successfully processed: $savedCount, Failed: $failedCount"
             ]);
+            
+            Log::info("syncTaskList completed", ['savedCount' => $savedCount, 'failedCount' => $failedCount]);
+
+            return $this->resSuccess(['savedCount' => $savedCount, 'failedCount' => $failedCount]);
+
+        } catch (Exception $e) {
+            Log::error("syncTaskList failed", ['error' => $e->getMessage()]);
+            if (isset($importDatasource)) {
+                $importDatasource->update([
+                    'status' => ImportDatasourceStatus::Failed->value,
+                    'response_body' => 'Critical failure: ' . $e->getMessage()
+                ]);
+            }
+            return $this->resError("Critical failure occurred: " . $e->getMessage());
         }
-
-        $importDatasource->update([
-            'status' => ImportDatasourceStatus::Success->value,
-            'message' => "Successfully processed: $savedCount, Failed: $failedCount"
-        ]);
-
-        BigdataResume::generateResumeData($importDatasource->id);
-
-        Log::info("syncTaskList completed", ['savedCount' => $savedCount, 'failedCount' => $failedCount]);
-
-        return $this->resSuccess(['savedCount' => $savedCount, 'failedCount' => $failedCount]);
     }
 
-
     public function syncTaskDetailSubmit($uuid, $token)
     {
         try{
             $url = "/api/pbg/v1/detail/" . $uuid . "/retribution/submit/";
+
             $headers = [
                 'Authorization' => "Bearer " . $token,
             ];
-    
+
-            $res = $this->service_client->get($url, $headers);
+            for ($attempt = 0; $attempt < 2; $attempt++) { 
-    
+                $res = $this->service_client->get($url, $headers);
-            if (empty($res->original['success']) || !$res->original['success']) {
+
-                // Log error
+                // Check if response is JsonResponse and decode it
-                Log::error("API response indicates failure", ['url' => $url, 'uuid' => $uuid]);
+                if ($res instanceof \Illuminate\Http\JsonResponse) {
-                return false;
+                    $decodedResponse = json_decode($res->getContent(), true);
+
+                    if (isset($decodedResponse['errors']['code']) && $decodedResponse['errors']['code'] === 'token_not_valid') {
+                        $initResToken = $this->getToken();
+
+                        if (!empty($initResToken->original['data']['token']['access'])) {
+                            $new_token = $initResToken->original['data']['token']['access'];
+
+                            $headers['Authorization'] = "Bearer " . $new_token;
+                            continue; 
+                        } else {
+                            Log::error("Failed to refresh token");
+                            return $this->resError("Failed to refresh token");
+                        }
+                    }
+                }
+
+                break;
             }
-    
+
-            $data = $res->original['data']['data'] ?? [];
+            // Ensure response is valid before accessing properties
+            $responseData = $res->original ?? [];
+            $data = $responseData['data']['data'] ?? [];
             if (empty($data)) {
-                Log::error("No data returned from API", ['url' => $url, 'uuid' => $uuid]);
                 return false;
             }
     
@@ -311,5 +546,118 @@ class ServiceSIMBG
         }
     }
 
-}
+    public function syncTaskAssignments($uuid){
+        try{
+            $init_token = $this->getToken();
+            $token = $init_token->original['data']['token']['access'];
+            $url = "/api/pbg/v1/list-tim-penilai/". $uuid . "/?page=1&size=10";
+            $headers = [
+                'Authorization' => "Bearer " . $token,
+            ];
 
+            $response = $this->service_client->get($url, $headers);
+            $datas = $response->original['data']['data'] ?? [];
+            if(empty($datas)){
+                return false;
+            }
+            $task_assignments = [];
+
+            foreach ($datas as $data) {
+                $task_assignments[] = [
+                    'pbg_task_uid' => $uuid,
+                    'user_id' => $data['user_id'],
+                    'name' => $data['name'],
+                    'username' => $data['username'],
+                    'email' => $data['email'],
+                    'phone_number' => $data['phone_number'],
+                    'role' => $data['role'],
+                    'role_name' => $data['role_name'],
+                    'is_active' => $data['is_active'],
+                    'file' => !empty($data['file']) ? json_encode($data['file']) : null, 
+                    'expertise' => !empty($data['expertise']) ? json_encode($data['expertise']) : null,
+                    'experience' => !empty($data['experience']) ? json_encode($data['experience']) : null,
+                    'is_verif' => $data['is_verif'],
+                    'uid' => $data['uid'],
+                    'status' => $data['status'],
+                    'status_name' => $data['status_name'],
+                    'note' => $data['note'],
+                    'ta_id' => $data['id'],
+                    'created_at' => now(),
+                    'updated_at' => now(),
+                ];
+            }
+            TaskAssignment::upsert(
+                $task_assignments,
+                ['uid'], 
+                ['ta_id','name', 'username', 'email', 'phone_number', 'role', 'role_name', 'is_active', 'file', 'expertise', 'experience', 'is_verif', 'status', 'status_name', 'note', 'updated_at']
+            );
+            return true;
+        }catch(Exception $e){
+            Log::error("Failed to sync task assignments", ['error' => $e->getMessage()]);
+            throw $e;
+        }
+    }
+
+    protected function convertToDecimal(?string $value): ?float
+    {
+        if (empty($value)) {
+            return null; // Return null if the input is empty
+        }
+
+        // Remove all non-numeric characters except comma and dot
+        $value = preg_replace('/[^0-9,\.]/', '', $value);
+
+        // If the number contains both dot (.) and comma (,)
+        if (strpos($value, '.') !== false && strpos($value, ',') !== false) {
+            $value = str_replace('.', '', $value); // Remove thousands separator
+            $value = str_replace(',', '.', $value); // Convert decimal separator to dot
+        }
+        // If only a dot is present (assumed as thousands separator)
+        elseif (strpos($value, '.') !== false) {
+            $value = str_replace('.', '', $value); // Remove all dots (treat as thousands separators)
+        }
+        // If only a comma is present (assumed as decimal separator)
+        elseif (strpos($value, ',') !== false) {
+            $value = str_replace(',', '.', $value); // Convert comma to dot (decimal separator)
+        }
+
+        // Ensure the value is numeric before returning
+        return is_numeric($value) ? (float) number_format((float) $value, 2, '.', '') : null;
+    }
+
+    protected function convertToInteger($value) {
+        // Check if the value is an empty string, and return null if true
+        if (trim($value) === "") {
+            return null;
+        }
+
+        $cleaned = str_replace('.','', $value);
+
+        // Otherwise, cast to integer
+        return (int) $cleaned;
+    }
+
+    protected function convertToDate($dateString)
+    {
+        try {
+            // Check if the string is empty
+            if (empty($dateString)) {
+                return null;
+            }
+
+            // Try to parse the date string
+            $date = Carbon::parse($dateString);
+
+            // Return the Carbon instance
+            return $date->format('Y-m-d');
+        } catch (Exception $e) {
+            // Return null if an error occurs during parsing
+            return null;
+        }
+    }
+
+    private function cleanString($value)
+    {
+        return isset($value) ? trim(strip_tags($value)) : null;
+    }
+}