Rearrange pages from front and back pdf files which are scanned from two-sided papers

 

1. Merge 0001.pdf and 0002.pdf into one.
2. Make a list of indexes. Interleave two indexes. First one is 0 to 19. Second one is reversed as 39 to 20.
3. Rearrange the merged.pdf as the ordered_indexes list.

I scanned both-sided papers into two pdf files, front pages and reversed back pages. Merge and rearrange pages from two pdf files into one pdf file.

script methods

1. https://unix.stackexchange.com/questions/53295/how-to-merge-2-pdf-files-with-interleaving-pages-order

tools

1. https://pdfsam.org/pdfsam-basic/

RearrangePdf-PdfFilePath_Output-PdfFilePath_OrdersList_Input.py

In [4]: from PyPDF2 import PdfFileMerger

In [6]: merger = PdfFileMerger()

In [11]: pdfs = ['/Users/.../Downloads/0001.pdf', '/Users/.../Downloads/0002.pdf']

In [12]: for f in pdfs: merger.append(f)

In [13]: merger.write("a.pdf")

In [14]: merger.close()

In [15]: from PyPDF2 import PdfFileReader, PdfFileWriter

In [16]: reader = PdfFileReader('a.pdf')

In [35]: f_page_idxes = range(20) ; b_page_idxes = reversed(range(20, 40)) ; fb_page_idxes = zip(f_page_idxes, b_page_idxes)

In [41]: ordered_idxes = list(itertools.chain(*fb_page_idxes))

In [42]: writer = PdfFileWriter()

In [43]: for p in ordered_idxes: writer.addPage(reader.getPage(p))

In [45]: with open("arranged_pdf.pdf", "wb") as f: writer.write(f)

Custom GPT chatbots for websites

  Open AI announced GPTs. GPT store, GPT4 turbo at Open AI dev day. 

We can build custom GPT chatbot for websites from https://docenty.ai/ .

Vercel database Prisma setup

 

PrismaClientKnownRequestError:
16:53:10.179	Invalid `prisma.workspace.findMany()` invocation:
16:53:10.179
16:53:10.180
16:53:10.180	The table `public.workspaces` does not exist in the current database.
16:53:10.180	at pn.handleRequestError (/vercel/path0/node_modules/@prisma/client/runtime/library.js:176:6477)
16:53:10.180	at pn.handleAndLogRequestError

npx prisma migrate dev

% npx prisma migrate dev

Environment variables loaded from .env

Prisma schema loaded from prisma/schema.prisma

Datasource "db": PostgreSQL database "verceldb", schema "public" at "ep-delicate-dust-021378.us-east-1.postgres.vercel-storage.com:5432"

Error: P3014

% npx prisma migrate resolve --applied 20220223015914_init_database

Environment variables loaded from .env

Prisma schema loaded from prisma/schema.prisma

Datasource "db": PostgreSQL database "verceldb", schema "public" at "ep-delicate-dust-021378.us-east-1.postgres.vercel-storage.com:5432"

Migration 20220223015914_init_database marked as applied.

% npx prisma migrate resolve --applied 20220508151141_add_domain_verification_columns

Environment variables loaded from .env

Prisma schema loaded from prisma/schema.prisma

Datasource "db": PostgreSQL database "verceldb", schema "public" at "ep-delicate-dust-021378.us-east-1.postgres.vercel-storage.com:5432"

Migration 20220508151141_add_domain_verification_columns marked as applied.

Prisma Migrate could not create the shadow database. Please make sure the database user has permission to create databases. Read more about the shadow database (and workarounds) at https://pris.ly/d/migrate-shadow

Original error:

db error: ERROR: permission denied to create database

   0: schema_core::state::DevDiagnostic

             at schema-engine/core/src/state.rs:266

Put env vars to vercel except VERCEL_ prefixed env vars

The value is not a valid System Environment name

Vector store pricings

 

candidates

https://js.langchain.com/docs/modules/indexes/vector_stores/integrations/

typesense cloud $14.40

https://cloud.typesense.org/pricing

https://qdrant.tech/pricing/

https://www.pinecone.io/pricing/

Free plan is not available for now.

https://weaviate.io/pricing

Standard

from

$ 25 /mo

$0.050 per 1M vector dimensions stored
or queried per month

supabase

https://supabase.com/blog/openai-embeddings-postgres-vector

vercel postgres

https://vercel.com/templates/next.js/postgres-pgvector

scrapy CrawlSpider instead of wget -r

 

I needed to download all pages from a wix-made website.

`wget -r` didn't work.

httrack , lynx didn't work, either.

https://askubuntu.com/questions/391622/download-a-whole-website-with-wget-or-other-including-all-its-downloadable-con

I could download websites with CrawlSpider and FollowLink of https://github.com/scrapy/scrapy

https://www.youtube.com/watch?v=o1g8prnkuiQ

I'll use playwrite later, too. (instead of selenium)

https://scrapeops.io/python-scrapy-playbook/scrapy-playwright/

I found some candidates

https://github.com/crawlab-team/crawlab

Using async in inline Editor of GCP Dialogflow. But, timeout too short.

 

Using async in inline Editor of GCP Dialogflow 

/* experimental: [asyncawait] */

https://stackoverflow.com/questions/42637630/does-jshint-support-async-await/48772304#48772304

to know queryText from the user

https://stackoverflow.com/questions/60408929/how-do-you-read-query-the-response-body-in-api-v2-of-dialogflow-fulfillment

function handleRequest(request, response) { const queryText = request.body.queryResult.queryText; // use the queryText variable to process the user's input }

sample code (without async)

https://github.com/priyankavergadia/AppointmentScheduler-GoogleCalendar/blob/master/index.js

Dialogflow CX timeout only 30 sec

Dialogflow ES timeout only 15 sec

https://groups.google.com/g/dialogflow-cx-edition-users/c/jajSEPqhYZE

Following code didn't work.

  async function answerQuestion(agent) {

    const response = await axios.post(

...    {

      message: JSON.stringify(request.body.queryResult.queryText)

    },

    {

      headers: { 'Content-Type': 'application/json' },

      timeout: 2 * 60 * 1000

    }

    );

    agent.setContext({ name: "Question", result: response });

    agent.add(`${response.data.data.answer} \n\n ${response.data.data.sources}`);

  }

Connect www domain from AWS Route53 to Wix

 

Customer care: https://support.wix.com/en/article/request-chat-with-a-customer-care-expert-for-support

https://www.wix.com/contact

Pointing method for Routh53

https://support.wix.com/en/article/connecting-a-domain-to-wix-using-the-pointing-method

https://console.aws.amazon.com/route53/

DNS checker

https://www.whatsmydns.net/

subdomain doesn't 

https://support.wix.com/en/article/connecting-a-subdomain-to-a-site-in-your-wix-account

Others

https://forums.aws.amazon.com/message.jspa?messageID=959490