Commit Graph

226 Commits

Author SHA1 Message Date
Kagami Sascha Rosylight eb7b5f905a
feat(backend): support OAuth 2.0 authorization (#11053)
* feat(backend): support OAuth 2.0 authorization

* secureRndstr fix

* nanndekowareta

* nanndekowareta2

* nanndekowareta3

* unref?

* refactor to not close fastify

* use microformats-parser

* Update OAuth2ProviderService.ts

* clarify the reason behind dns lookup

* refactor(backend): use @types/oauth2orize-pkce (#11350)

* refactor(backend): use @types/oauth2orize-pkce

* Update package.json

* Update pnpm-lock.yaml

---------

Co-authored-by: Kagami Sascha Rosylight <saschanaz@outlook.com>

---------

Co-authored-by: mtgto <hogerappa@gmail.com>
Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-07-27 18:51:58 +09:00
Acid Chicken (硫酸鶏) cf3ac3c0be
build: close #10953 2023-07-26 22:06:00 +09:00
Acid Chicken (硫酸鶏) e6fca72171
perf: use slacc instead of unzipper (#10780)
Co-authored-by: tamaina <tamaina@hotmail.co.jp>
2023-07-20 17:00:54 +09:00
woxtu 5f5c4fc44f
Remove unused dependencies (#11327) 2023-07-20 06:53:35 +09:00
syuilo 54c0ed2ed7 update deps 2023-07-18 20:00:45 +09:00
syuilo 545371011a use happy-dom 10.0.3
Resolve #11287
2023-07-16 07:43:55 +09:00
woxtu b392f44b81
refactor(backend): Improve UUID generation (#11286)
* Replace with `crypto.randomUUID()`

* Remove uuid
2023-07-15 18:39:38 +09:00
syuilo 9a5bc78eb4 update deps 2023-07-15 16:07:30 +09:00
syuilo 1f181536ae use engines 2023-07-08 08:52:51 +09:00
popkirby 8daca59ca6
perf(backend): use mutex for nsfw model loading (#11109)
Co-authored-by: tamaina <tamaina@hotmail.co.jp>
2023-07-08 07:27:26 +09:00
syuilo d5c4e77c44 update deps 2023-07-07 10:53:06 +09:00
syuilo 8099bc24e1
refactor(backend): use node16 for moduleResolution (#10938)
* refactor(backend): use node16 for moduleResolution

* update deps

* Update tsconfig.json

* ✌️

* revive KEYWORD

* restore strict-event-emitter-types dependency

* restore ms dependency

* cancel redundant import reorder

* fix

* Delete ms.ts

* remove rndstr

---------

Co-authored-by: Kagami Sascha Rosylight <saschanaz@outlook.com>
2023-06-25 21:13:15 +09:00
Kagami Sascha Rosylight ef354e94f2
refactor(backend): replace rndstr with secureRndstr (#11044)
* refactor(backend): replace rndstr with secureRndstr

* Update pnpm-lock.yaml

* .js
2023-06-25 11:04:33 +09:00
Kagami Sascha Rosylight a2c0573f84
refactor(backend): replace private-ip with ipaddr.js (#11041)
* refactor(backend): replace private-ip with ipaddr.js

* restore ip-cidr
2023-06-25 06:35:09 +09:00
syuilo 60cc7f62e6 update deps 2023-06-24 13:11:53 +09:00
syuilo 91d790bbb6 update deps 2023-06-02 11:34:38 +09:00
syuilo f930eaee02
perf(backend): use websockets/ws instead of theturtle32/WebSocket-Node (#10884)
* perf(backend): use websockets/ws instead of theturtle32/WebSocket-Node

Resolve #10883

* refactor

* Update StreamingApiServerService.ts

* Update StreamingApiServerService.ts

* ✌️

* Update StreamingApiServerService.ts

* fix main stream init

* fix timing 2

* setIntervalの重複を避ける(気休め)

* add comment

* ✌️

---------

Co-authored-by: tamaina <tamaina@hotmail.co.jp>
2023-05-29 13:32:19 +09:00
syuilo fd7b77c542
enhance(backend): migrate bull to bullmq (#10910)
* wip

* wip

* Update QueueService.ts

* wip

* refactor

* ✌️

* fix

* Update QueueStatsService.ts

* refactor

* Update ApNoteService.ts

* Update mock-resolver.ts

* refactor

* Update mock-resolver.ts
2023-05-29 11:54:49 +09:00
tamaina 4129ac157a package.jsonの並び替えを修正 2023-05-25 14:50:14 +00:00
syuilo 1de774fa3d update deps 2023-05-24 10:16:42 +09:00
Acid Chicken (硫酸鶏) 81fd94e635
chore: update slacc (#10867)
Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-05-20 10:34:31 +09:00
syuilo acd5e0b8f6 update deps 2023-05-19 16:34:56 +09:00
syuilo 6f1994c665 update deps 2023-05-12 11:41:53 +09:00
Acid Chicken (硫酸鶏) 4a72941eda
perf: use slacc on check-word-mute (#10721)
* perf: use slacc on check-word-mute when all of specified words are single word

* perf: use slacc as possible

* build: avoid tarball

* chore: update slacc

* build: update package name
2023-05-05 19:49:34 +09:00
syuilo 5c08f2b93b
feat: Introduce Meilisearch (#10755)
* wip

* wip

* Update SearchService.ts

* Update SearchService.ts

* wip

* wip

* Update SearchService.ts

* Update CHANGELOG.md

* wip

* Update SearchService.ts

* Update docker-compose.yml.example
2023-05-05 08:52:14 +09:00
syuilo bcd123371b update deps 2023-05-02 20:52:36 +09:00
syuilo 8c9cb9ee15 update deps 2023-04-19 12:52:14 +09:00
syuilo 5f67ca434d update ioredis 5.x 2023-04-14 10:09:03 +09:00
syuilo 88f22da052 update deps 2023-04-06 20:22:26 +09:00
tamaina 26068a3a8f use workspace:*, use pnpm@8.1.0 2023-03-30 13:01:00 +00:00
syuilo bb2b33f2c9 update deps 2023-03-30 12:03:04 +09:00
Kagami Sascha Rosylight cee1d5e2d0
chore: integrate misskey-js as a workspace item (git subtree) (#10409)
* Additional changes for the merge

* api-misskey-js
2023-03-30 09:33:19 +09:00
Kagami Sascha Rosylight abdb43c440 Revert "Additional changes for the merge"
This reverts commit efb5e1d1cc.
2023-03-25 08:20:34 +01:00
Kagami Sascha Rosylight efb5e1d1cc Additional changes for the merge 2023-03-25 08:13:30 +01:00
YS 658901a47f
bump aws-sdk to v3 for s3 (#10363)
* indent

* aws-sdk v3移行
2023-03-23 13:48:14 +09:00
syuilo c0bad443ff update deps 2023-03-10 14:00:14 +09:00
tamaina c36e7d1a07
enhance(server): メディアプロキシでico,bmpを読めるように (#10186)
* enhance(server): downloadUrlでContent-Dispositionからファイル名を取得
Resolve #10036
Resolve #4750

* untitled

* オブジェクトストレージのContent-Dispositionのファイル名の拡張子をContent-Typeに添ったものにする

* ✌️

* tiff

* fix filename

* add test

* /files/でもContent-Disposition

* enhance(server): メディアプロキシでico,bmpを読めるように
Fix #10120

* comment

* fix test

---------

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-03-04 19:23:11 +09:00
Kagami Sascha Rosylight 61215e50ff
test(backend): APIテストの復活 (#10163)
* Revert 1c5291f818

* APIテストの復活

* apiテストの移行

* moduleNameMapper修正

* simpleGetでthrowしないように

status確認しているので要らない

* longer timeout

* ローカルでは問題ないのになんで

* case sensitive

* Run Nest instance within the current process

* Skip some setIntervals

* wait for 5 seconds

* kill them all!!

* logHeapUsage: true

* detectOpenHandlesがじゃましているらしい

* maxWorkers=1?

* restore drive api tests

* workerIdleMemoryLimit: 500MB

* 1024MiB

* Wait what
2023-03-03 11:13:12 +09:00
syuilo 76f3bdcdf9 update deps 2023-02-26 18:51:45 +09:00
kabo2468 1c9c9745f5
Windows環境でswcを使うと正常にビルドができない問題の修正 (#10074)
* Update @swc/core to v1.3.36

* Update CHANGELOG.md

* Update CHANGELOG.md
2023-02-25 05:22:36 +09:00
Kagami Sascha Rosylight 9edd0d25c2
Pass `--detectOpenHandles` to Jest (#9895)
Co-authored-by: tamaina <tamaina@hotmail.co.jp>
2023-02-24 14:37:22 +09:00
Masaya Suzuki 6b52403d05
起動時にRedisの疎通確認を行う (#9832)
* 起動時にRedisの疎通確認を行う

* check:connectをstart内に移動

---------

Co-authored-by: tamaina <tamaina@hotmail.co.jp>
2023-02-24 14:09:17 +09:00
CaffeinePower cde0eb621d
feat(server): add @swc/core-android-arm64 to optional (#10034)
* feat: add optional swc

* fix: windowsで動かない現象を修正

* fix: fix swc path alias

* fix: docker build時に`Host key verification failed`と言われてgitリポジトリからパッケージをインストールできないのでssh -> htpsに変更

* feat(server): add @swc/core-android-arm64 to optional

* fix: conflict
2023-02-23 16:23:16 +09:00
syuilo 4e23500732 use swc 2023-02-23 15:36:47 +09:00
CaffeinePower b965f5e4a9
feat: swc build in windows (#10032)
* feat: add optional swc

* fix: windowsで動かない現象を修正

* fix: fix swc path alias

* fix: docker build時に`Host key verification failed`と言われてgitリポジトリからパッケージをインストールできないのでssh -> htpsに変更
2023-02-23 15:36:17 +09:00
syuilo d1a69abf81 use tsc for build
Windowsだとエラーが出るため
2023-02-23 11:06:23 +09:00
syuilo 28bea88da0
Update package.json 2023-02-23 10:17:00 +09:00
tamaina f7c6ea93d7
perf(backend): Use swc on pnpm build (#10026)
* perf(backend): Use swc on pnpm build

* update CHANGELOG

* no jest
2023-02-22 23:09:24 +09:00
potpro bd13ea3d2c
MFMのDOM ParserをJSDOMからhappy-domに変更する (#10016)
Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-02-22 17:32:45 +09:00
syuilo 716ffcace6 update deps 2023-02-20 17:04:57 +09:00
tamaina 980bf1306e
🎨 2FA設定のデザイン向上 / セキュリティキーの名前を変更できるように (#9985)
* wip

* fix

* wip

* wip

* ✌️

* rename key

* 🎨

* update CHANGELOG.md

* パスワードレスログインの判断はサーバーで

* 日本語

* 日本語

* 日本語

* 日本語

* ✌️

* fix

* refactor

* トークン→確認コード

* fix password-less / qr click

* use otpauth

* 日本語

* autocomplete

* パスワードレス設定は外に出す

* 🎨

* 🎨

---------

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-02-20 16:40:24 +09:00
Kagami Sascha Rosylight dd52be3a01
ci: run typecheck and eslint separately (#9966)
* ci: run typecheck and eslint separately

* fix syntax
2023-02-17 10:57:40 +09:00
tamaina 4e68126c06
enhance(server): URLプレビュー(summaly)はプロキシを通すように (#9905)
* enhance(server): URLプレビュー(summaly)はプロキシを通すように

* update summaly

* update summaly

* 型エラーバスター

* basic.html

* Delete basic.html

---------

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-02-14 14:17:07 +09:00
syuilo 54df243b90 fix: typeorm migrations not working
Fix #9868
2023-02-11 10:49:17 +09:00
syuilo 1ff14d81c1 update deps 2023-02-09 09:25:31 +09:00
syuilo 825551d64f drop syslog
Close #9774
2023-02-03 15:08:36 +09:00
syuilo 65ed702d87 update deps 2023-02-03 14:44:09 +09:00
syuilo 4b43745e7c fix(test): add @jest/globals 2023-02-02 10:26:29 +09:00
syuilo d8f33bc0af update deps 2023-01-27 11:40:18 +09:00
syuilo 30dce42e03 fix deps 2023-01-25 12:17:53 +09:00
syuilo d4fb201d05 fix(server): node-fetchおよびgotを使う以前の実装に戻す
see #9710
2023-01-25 12:00:04 +09:00
syuilo da274cd458 update deps 2023-01-24 14:49:29 +09:00
syuilo 083fa53d9c update deps 2023-01-23 20:13:18 +09:00
syuilo a3aafa03ad update deps 2023-01-22 04:17:58 +09:00
syuilo b8afabde2c add commands for build with swc 2023-01-19 16:58:09 +09:00
CyberRex 6e2d7e9792
Use pnpm for package manager (#9531)
* Use pnpm for package manager

* Fix

* Change github workflow

* use pnpm in workflow

* fix

* Fix test (e2e/jest)

* Update Dockerfile for pnpm

* Exclude node_modules from file search on VSCode

* Update pnpm-lock.yaml

* Update pnpm-lock.yaml

* Move typescript from devDependencies to dependencies

* Fix Dockerfile

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-01-16 06:08:42 +09:00
syuilo cedb4267ba update deps 2023-01-15 09:19:02 +09:00
syuilo 68e65ed5df update mfm-js 2023-01-14 09:02:33 +09:00
syuilo 74910f8d70 Revert "perf: build backend with swc (#9463)"
This reverts commit 4579d02296.
2023-01-13 09:32:56 +09:00
파링 4579d02296
perf: build backend with swc (#9463)
* feat: build backend with swc

* fix: swc build target

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2023-01-12 21:05:45 +09:00
tamaina 978a9bbb3b
perf(backend): Use undici instead of node-fetch and got (#9459)
* Implement? HttpFetchService

* ✌️

* remove node-fetch

* fix

* refactor

* fix

* gateway timeout

* UndiciFetcherクラスを追加 (仮コミット, ビルドもstartもさせていない)

* fix

* add logger and fix url preview

* fix ip check

* enhance logger and error handling

* fix

* fix

* clean up

* Use custom fetcher for ApRequest / ApResolver

* bypassProxyはproxyBypassHostsに判断を委譲するように

* set maxRedirections (default 3, ApRequest/ApResolver: 0)

* fix comment

* handle error s3 upload

* add debug message

* no return await

* Revert "no return await"

This reverts commit b5b0dc58a342393d260492e3a6f58304372f53b2.

* reduce maxSockets

* apResolverのUndiciFetcherを廃止しapRequestのものを使う、 add ap logger

* Revert "apResolverのUndiciFetcherを廃止しapRequestのものを使う、 add ap logger"

This reverts commit 997243915c8e1f8472da64f607f88c36cb1d5cb4.

* add logger

* fix

* change logger name

* safe

* デフォルトでUser-Agentを設定
2023-01-12 21:03:02 +09:00
syuilo 6a18360269 update mfm-js 2023-01-09 16:07:14 +09:00
syuilo 3e7d8b5f17 update deps 2023-01-06 19:59:31 +09:00
syuilo e44f83fb9c update AiScript to 0.12.0 2023-01-03 15:51:49 +09:00
syuilo a9f4217214 update deps 2023-01-02 20:02:51 +09:00
tamaina 8b46edeccf
enhance: Proxy custom emojis to reduce image size and accelerate the frontend (#9431)
* fix(server): /emoji to accept `@.` host expression

* fix(client): use MkEmoji for custom emoji in MkEmojiPicker

* change convertToWebp

* nanka iroiro

* remove

* fix

* nearLosslessは労多くして益少なしなのでやめる

* do not cleanup tmp for development

* update sharp.js to 0.31.3

* mixed: true

* fix MkAutocomplete of 912791b3ab

* clean up

* https://github.com/misskey-dev/misskey/pull/9431#discussion_r1059215943
2022-12-30 12:00:50 +09:00
syuilo 25c8d7782d update deps 2022-12-28 18:28:01 +09:00
syuilo b0e3bc1f03 update deps 2022-12-23 08:58:02 +09:00
tamaina 2fe86fd869
enhance: Vite HMR while yarn dev, and more build tuning (#9361)
* enhance: Vite HMR while yarn dev, and more build tuning

* use localhost

Co-authored-by: syuilo <Syuilotan@yahoo.co.jp>
2022-12-20 13:05:36 +09:00
syuilo 9e9142a110 update depsd 2022-12-19 13:20:47 +09:00
Kagami Sascha Rosylight af9034355c
Remove redundant ts-node things (#9335) 2022-12-18 07:51:31 +09:00
Kagami Sascha Rosylight 4b98920f02
Fix import related TypeScript errors (#9321)
* Add missing @types packages

* Fix TS1272 type only imports

* Fix TS2821 import assertion
2022-12-14 00:01:45 +09:00
Kagami Sascha Rosylight f30d54fe88
Call `tsc --noEmit` also for backend/client (#9316) 2022-12-13 00:40:30 +09:00
syuilo c5213dddbf update deps 2022-12-10 16:38:41 +09:00
syuilo f1855020ad update dep 2022-12-06 12:31:50 +09:00
syuilo b4be9d270c perf(server): improve syslog performance 2022-12-06 09:38:55 +09:00
syuilo c0c23b135c bull-board復活 2022-12-04 17:33:51 +09:00
syuilo 2b1a673e32 chore: remove needless experimental-json-modules flag 2022-12-04 10:52:53 +09:00
syuilo 69016735be update deps 2022-12-04 10:39:11 +09:00
syuilo 3a7182bfb5
Fastify (#9106)
* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* fix

* Update SignupApiService.ts

* wip

* wip

* Update ClientServerService.ts

* wip

* wip

* wip

* Update WellKnownServerService.ts

* wip

* wip

* update des

* wip

* Update ApiServerService.ts

* wip

* update deps

* Update WellKnownServerService.ts

* wip

* update deps

* Update ApiCallService.ts

* Update ApiCallService.ts

* Update ApiServerService.ts
2022-12-03 19:42:05 +09:00
syuilo 594c329dbd update deps 2022-11-29 13:14:57 +09:00
Kainoa Kanter bdbc448d13
refactor: migrate to Yarn Berry (v3.2.1) (#8764)
* Yarn berry

* Add `.yarn` to dockerignore

* Mention in CHANGELOG

* Update Dockerfile

* Proper upgrade to yarn

* use `"packageManager"`

* Replace `install-packages.js` with workspaces

* Replace `install-packages.js` with workspaces

* Typo

* `corepack enable` for linting

* Remove `packages/*/yarn.lock`

* Improve lint workflow

* Update .github/workflows/lint.yml

Co-authored-by: Acid Chicken (硫酸鶏) <root@acid-chicken.com>

* Update .github/workflows/lint.yml

Co-authored-by: Acid Chicken (硫酸鶏) <root@acid-chicken.com>

* Add `eslint`

* Regenerate yarn.lock

* 🙏‍

* Update lint.yml

🤔

* Fix workflow!

* yarn lint my beloved

* corepack enable for mocha/e2e

* Update CHANGELOG.md

* fix the code that depends on node_modules

* tbh

* tbh

* More yarn workspaces stuff

* 🍀

* Change `browser-image-resizer`

* :finnadie:

* :goberserk:

* :godmode:

* Remove yarnrc for workspaces

* 🙏

* Add proper packages for eslint

* Skip extra install

* New steps for test.yml too

* uhh

* Update .dockerignore

* Update lint.yml

* Update test.yml

* Make client/backend lints seperate workflows

* package.json names

* pnpm = dont change paths

* Fix changelog

* :bowtie:

* I don't know why github workflows hates me...

* test

* ?????

* continue-on-error: true

* Fix yarn.lock

Co-authored-by: ishowta <ishowta@gmail.com>

* add @rollup/pluginutils

* add packageExtensions for chartjs_date-fns

Co-authored-by: acid-chicken <root@acid-chicken.com>

* npm run => yarn

* wip

* yarn node => node

依存関係の記載不足の解消がかなり多いため、yarn nodeは使わない

* fix

* fix http-signature

* fix

* fix

* add packageExtensions

* ✌️

* remove `yarn set version berry`

* yarn install --immutable

Co-authored-by: ishowta <ishowta@gmail.com>

* https://github.com/misskey-dev/misskey/pull/8764#discussion_r885749892

* enable actions/setup-node's global cache

* Update .gitignore

Co-authored-by: iwata <ishowta@gmail.com>

* revival gulp build
66ab7591bf (r885899944)

* fix lockfile

* Update packages/backend/package.json

Co-authored-by: iwata <ishowta@gmail.com>

* remove packagemanager

* `yarn run gulp` in `build` instead of just `gulp`

* Update CHANGELOG.md

* update lockfile

* Add .yarn/cache to gitignore for packages

* ?

* move resolutions

* ✌️

* update lockfie

* update-lockfile

* update yarn.lock

* fix build

* fix

* fix

* fix: add @tensorflow/tfjs

* ダメ

* modify lockfile

* use yarnrc

* update yarnlock

* add jest-mock

* update-lockfile

* update lockfile

* update lockfile

* move jest-mock, update lockfile

Co-authored-by: Acid Chicken (硫酸鶏) <root@acid-chicken.com>
Co-authored-by: tamaina <tamaina@hotmail.co.jp>
Co-authored-by: ishowta <ishowta@gmail.com>
2022-11-24 15:39:00 +09:00
syuilo aa8693e8df update deps 2022-11-19 10:25:16 +09:00
syuilo 49daa56a64 update deps 2022-11-13 11:14:07 +09:00
syuilo 5e21fd2caf update deps 2022-10-28 16:08:27 +09:00
syuilo fd5976f378 fix type 2022-09-24 17:07:56 +09:00
syuilo 89ef21e3b0 fix type 2022-09-24 16:53:53 +09:00
syuilo 92bfcb9b60
Update package.json 2022-09-23 04:19:13 +09:00
syuilo 8e6f1508ed use swc for jest 2022-09-22 04:51:16 +09:00
syuilo e7cdc53c7b test 2022-09-21 04:50:16 +09:00