Spanish media coverage: Rio-Mesi (Leo Messi) and his entire family are in Barcelona. In fact, an empty Rio would return to Barcelona, because Bassa was his home and would like to return to Basar next year if the conditions were appropriate. In the next few hours, Argentines are planning to meet with some former team friends and friends in Bassa to enjoy, spend time and share ideas on the future.

A paper published by meta AI yesterday can be said to have blown the pot. The paper website paperswitchcode ranks first in the hot search list. Many AI leaders recommend:

Professor Sepp Hochreiter, the initiator and founder of LSTM and the founder of the Austrian Institute of advanced artificial intelligence (iarai), publicized on Twitter:

Reddit, a social networking and news website, also has a large number of discussions:

Some researchers said that this is a major step to introduce large-scale LM research into academia. In one sentence, meta AI is opening access to large language models for AI research, and indicates that this model with 175 billion parameters is the first model that can be used by a wider AI research community. It is worth noting that gpt-3 proposed by openai also has 175 billion parameters. I don’t know whether this number is a coincidence or something else.

Let’s introduce the main contents of this study.

Meta AI open 175 billion parameter model

Large language models, natural language processing (NLP) systems with more than 100 billion parameters, have changed NLP and AI research in the past few years. After a lot of text training, these models show amazing ability in generating creative text, solving mathematical problems, answering reading comprehension and so on.

Although in some cases, the public can interact with these models through paid APIs, full research access is still limited to a few resource rich laboratories. This limited access limits the ability of researchers to understand how and why these large language models work, and hinders the progress of known problems such as improving their robustness and reducing bias.

According to the commitment of meta AI to open science, they are sharing open pre trained transformer (opt-175b), which is a model with 175 billion parameters and trained on public data sets. Meta AI hopes that more communities will participate in understanding the basic technologies related to large models.

Thesis address: https://arxiv.org/pdf/2205.01068.pdf

For a language technology system of this scale, this version includes the pre training model and the code required to train and use them for the first time. In order to maintain integrity and prevent abuse, meta AI will release the model under non-commercial license to focus on research use cases. Access to the model will be granted to academic researchers; Personnel affiliated with the government, civil society and academic organizations; And industrial research laboratories around the world.

Meta AI hopes that the whole Ai Community, including academic researchers, civil society, policy makers and other researchers, will work together to develop clear guidelines around responsible AI, especially responsible large-scale language models, because they are at the center of many downstream language applications. The artificial intelligence community needs to access these models in order to conduct repeatable research and jointly promote the development of this field. With the release of opt-175b and small-scale baseline, meta AI also hopes to increase ethical considerations.

Public record documents

According to the publication guidelines developed by the AI partnership on AI for researchers and the governance guidelines outlined by NIST in March 2022 (Section 3.4), meta AI will publish all documentation of the development process, including a complete logbook detailing the daily training process, so that other researchers can more easily build on this work. In addition, these details also reveal the amount of computation used to train opt-175b and the labor cost required when the underlying infrastructure or the training process itself becomes unstable on a large scale.

In this regard, some researchers said: the research team’s logbook is a hidden gem, highlighting the pain points / broader problems in ML research that have existed and have not been solved since Lua torch:

Meta AI only uses 16 NVIDIA V100 GPUs to train and deploy the code base of models to increase the accessibility of these models for research purposes. Meta AI also fully released a set of smaller baseline models, using the same data set and setting as opt-175b, so that researchers can study the impact of model scale alone. The parameters of these small-scale models include 125 million, 350 million, 1.3 billion, 2.7 billion, 6.7 billion, 13 billion and 30 billion (66 billion to be released soon).

The latest development of artificial intelligence research consumes a lot of computing power. Although industry laboratories have begun to report the carbon footprint of these models, most do not include the computational costs associated with the experimental R & D phase, which may in some cases consume an order of magnitude more resources than training the final model.

Meta AI considered energy efficiency when developing opt-175b, and its carbon footprint is only 1 / 7 of gpt-3. This is achieved by combining meta’s open source full fragment data parallelism (FSDP) API and NVIDIA’s tensor parallelism abstraction in Megatron LM. Meta AI has achieved about 147 tflop / S / GPU utilization on NVIDIA’s 80 GB A100 GPU, which is about 17% higher than the data published by NVIDIA researchers on similar hardware.

By sharing with the code base

Texas governor Greg Abbott made a similar suggestion last week that musk should move twitter to Texas and “join Tesla, SpaceX and the boring company”.

Musk, the world’s richest man, moved Tesla’s headquarters to Texas last year when the company clashed with the governor of California over the new crown epidemic prevention policy. Lorena Gonzalez, a California congresswoman, even tweeted insulting musk in 2020.

Musk referred to the decision at that time, saying that “people can’t afford house prices (Fremont, California)” and “the scale of enterprises in the bay area is also limited”.

Parker pointed out that after musk moved Tesla and SpaceX to Texas, he believed that “he is likely to move twitter headquarters too”. He added that Texas lawmakers encouraged this.

“We will support this approach and we will put on a red carpet to welcome him.” “But the key is that he lived here and experienced the difference brought by Texas,” he said

Parker added, “our state has a low tax rate and we don’t collect income tax. The environment here is excellent. Compared with California, their income tax is high and the tax burden is heavy, which is obvious at the local level, especially in the bay area.”

Musk once said he wanted to make twitter “better than ever”.

“Free speech is the cornerstone of democratic operation. Twitter is a digital city square. Issues vital to the future of mankind will be discussed here.” Musk said in the statement of twitter privatization transaction, “I also hope to make twitter better than ever, improve products through new functions, improve trust through open source algorithms, crack down on spam robots and authenticate everyone.”

Musk said in a recent filing with the securities and Exchange Commission that he invested in twitter because he believed that “it has the potential to become a platform for free speech around the world. I believe that free speech is a necessary condition for the operation of democracy.”

“Twitter has great potential.” He added, “I want to unleash its potential.”

[Shenzhen business daily] (reporter Li Xiuyu) good news came from the construction of Shenzhen Metro phase IV project. On April 8, after more than four hours of continuous test, the hot sliding test of the first commissioning section of Shenzhen Metro Line 12 was successfully completed, marking the official start of the joint commissioning of equipment and system with traffic dispatching as the main line of the whole line.

As the “king of transfer” of the subway with 18 transfer stations, Metro Line 12 will officially welcome passengers at the end of this year. At that time, the subway will go directly to the airport and the exhibition area.

Metro Line 12 starts from zuobaotai station in the South and ends at haihaitianyuan east station in the north. It connects Shekou Free Trade Zone, Nanshan central area, Bao’an central area, Xixiang area, airport east area, Fuyong area, Dakang area and Convention and exhibition area from south to north. It is the backbone of rail transit supporting the western development axis of Shenzhen. The whole line is 40.56 kilometers long, with 33 stations in total, including 18 transfer stations.

“Hot sliding” is a common term in the rail transit industry. It mainly refers to the first live operation test of the train on the new line. The pantograph of the electric bus takes power directly from the catenary and drives it by itself to complete all operations such as startup, traction and braking. The thermal sliding test is a comprehensive test on the stability of line power supply system, catenary, track, platform door, communication system, gauge and vehicle operation, so as to confirm whether the cooperation between vehicle and catenary system, vehicle and track system meets the conditions for train operation.

The hot slide was organized by Shenzhen Metro Group. Experts and technicians from Shenzhen line 12 company, China power construction south company and other relevant units participated in the hot slide test. In the hot sliding test of the first commissioning section of metro line 12, the metro train starts from the East depot of the airport, runs along the outgoing section to Shangchuan station, and ends at Huangtian station, with a one-way journey of 10.9 kilometers.

In order to fully carry out the hot slide test, the train runs back and forth from the left and right lines at low speed (no more than 20 km / h), medium speed (no more than 40 km / h) and high speed (60-80 km / h). The total mileage of the hot slide test is about 65 km, and the maximum running speed is 80 km / h. Through the hot sliding test, the power supply, catenary, track, equipment and other systems are inspected, and the current collection of vehicles and the relationship between pantograph and catenary are analyzed.

At present, all the stations of metro line 12 are capped, all the tunnels are connected, and the construction of station decoration and ancillary structures is actively advancing. According to the plan, Metro Line 12 will be put into trial operation this year. At that time, it will greatly optimize the public transport structure of Nanshan central area and Bao’an central area, improve the public travel environment and effectively improve the urban quality of Shenzhen.

The report said that the main topics to be discussed by these intelligence officials will involve China.

It is reported that these officials will also participate in the “risina dialogue” held in India on the 25th, which is one of the highest standard and most influential official forums in India. (compiled by / Yang Wenjing)

Due to the continuous oversupply, the high vacancy rate has been the norm of Shenzhen office market in recent years.

Cushman & Wakefield’s data show that the vacancy rate of Grade A office buildings in Shenzhen has risen to 22.2% in the first quarter of this year, up 2.9 percentage points from the previous quarter, and the pressure to go up is increasing. Meanwhile, the net absorption of office buildings in the first quarter decreased significantly by 82.8% month on month.

The reporter of China Business Daily found that the excessive supply reduced the return rate of the office market. With the continuous reduction of rent, it is difficult to sell first-hand office buildings, most of which are lower than 15% ~ 20% of the market listing price. There are also many concessions in the office rental market, such as price for quantity, extension of rent free period, decoration subsidies and so on.

Facing the problem of oversupply in the office market, recently, Shenzhen has played a “combined fist” of inventory and supply cooling. Last year, Shenzhen issued several measures on further increasing the supply of residential land to encourage the conversion of land or buildings for commercial purposes into residential purposes.

At the same time, the reporter combed the construction land supply plan in recent years. In 2021, the commercial land planned to be supplied in Shenzhen accounted for 4.6% of the total planned supply, which was 51% lower than that in 2020. The change of land supply structure can be described as significant. The “competitive relationship” between land for future economic development and residential land will continue to attract attention. As of press time, the supply plan of construction land in Shenzhen in 2022 has not been announced yet.

Rent decline and extension of rent free period

“The highest rent of excellence Times Square was 250 yuan / square meter per month last year, and now the rent is only 150 ~ 200 yuan.” Manager Yang is a senior intermediary manager in Futian CBD area. He said that in recent years, a large number of surrounding office buildings have entered the market, and it is difficult for the rent to rise. At present, the rent reduction of medium and low-end office buildings and the promise of rent free period of half a month to one month have become an important means for owners to attract customers.

As one of the most concentrated areas of office buildings in Shenzhen, the rental and sales situation of Futian CBD can be described as the epitome of the industry. Savills statistics show that due to the pressure of decontamination faced by some projects and the impact of millions of new supply during the year, the bargaining attitude of owners is soft. In the first quarter of this year, the average rent in the city fell to 182.9 yuan per square meter per month, and the rent index decreased by 0.9% month on month and 0.6% year-on-year.

In Qianhai District, which has been hotly discussed by the market for a long time, the competition between office buildings is also extremely fierce. In Qianhai International Center, the intermediary manager told reporters that the owner of a hardbound office building with an area of 158 square meters quoted 21300 yuan / month last year. Now the owner is willing to reduce the price for rent. As long as it can be rented in April, it can be reduced to 20000 yuan a month.

In fact, the above Futian and Qianhai are the hot spots of office buildings in Shenzhen. Qianhai, in particular, became a hot area of office rental demand in Shenzhen last year due to the government’s rent preferential homing plan and industrial listing subsidies.

According to Dead Leung Ban’s data, in 2021, Qianhai received 294 thousand square meters, accounting for 43.8% of all grade A offices in the city. However, by the end of 2021, the vacancy rate in Qianhai area was still about 30%, compared with more than 50% previously.

Affected by seasonal factors and epidemic prevention and control, in the first quarter of 2022, the activity of Shenzhen office market decreased significantly compared with the level of the previous year. In the first quarter, the area of Grade A office buildings put into use in Shenzhen was 335000 square meters, which was basically equivalent to the supply level of last year, but the absorption of Grade A office buildings in the first quarter was only 66575 square meters, a decrease of 28.5% compared with the same period last year.

Under the influence of the relationship between supply and demand, the vacancy rate rebounded to 22.2% in this quarter, an increase of 2.9 percentage points over the previous quarter and a decrease of 3.4 percentage points over the same period last year. This is also the vacancy rate rebounded to more than 20% after four consecutive quarters of decline at the beginning of last year.

In fact, the office buildings in Shenzhen had a strong rebound last year, and the vacancy rate narrowed. Cushman & Wakefield’s annual report shows that the vacancy rate of Grade A office buildings in Shenzhen dropped to 19.01% in 2021, the first time that Shenzhen’s grade A office vacancy rate returned to the 20% level since 2019. The absorption also reached 672600 square meters, a year-on-year increase of 66.8%. This absorption is the second highest in the last five years.

The market is under great pressure to decontaminate

The Cushman & Wakefield’s analysis of the first quarter of the first quarter of the resumption of vacancy rate, DTZ analysis, office market activity decline is affected by epidemic factors, so the overall activity recovery is expected to depend on the epidemic control and resumption of production progress.

Zhang Xiaoduan, vice president of Cushman & Wakefield Research Institute and director of Southern China research division, pointed out that although the suspension of the project will directly affect the duration of the projects under construction, it is expected that 628 thousand square meters of new supply will be put into use during the year. Combined with the pressure on the demand side, the vacancy rate of Grade A office buildings in Shenzhen may rise in the short term.

Although the vacancy rate is high, the absorption capacity of Shenzhen office buildings last year is not low. From Cushman & Wakefield’s net absorption, according to DTZ, Shenzhen in 2021 was the first in the core city of the country with a net absorption of 640 thousand and 700 square meters, and more than second of Shanghai’s nearly 110 thousand square meters. Guangzhou and Beijing, which ranked third and fourth, both absorbed less than 500000 square meters. However, by the first quarter of this year, the rental demand of office buildings in Shenzhen had been impacted by the local epidemic, and the net absorption had decreased by 82.8% month on month.

The development momentum of tertiary industries such as finance and it is still strong, and continue to be the main demand for Grade A office buildings in Shenzhen. Statistics show that the performance of the financial industry is strong, and the lease transaction area accounts for 41.7%, of which 71.3% are state-owned holding enterprises. When the economy is facing downward pressure, large state-owned enterprises and central enterprises have shown stronger anti risk ability.

In addition, the rental area from TMT industry accounted for about 12.3% in this quarter; The professional service industry dominated by law firms and design companies, as well as the commerce and trade industry including cross-border e-commerce, remained active and recorded a large area of leasing transactions. From the perspective of regional distribution, Qianhai and Futian CBD attracted more than 40% of the demand of the financial industry in the first quarter, which are the two most preferred areas of the financial industry

Yang Yang wore 3R environmental protection series upper luxury shoes and shoes, with a wide suit coat and simple tannin trousers. The eye-catching h character on the shoe body lit up the cool attitude and performed a vibrant style. Yang Yang enthusiastically shared his concept of environmental protection with the on-site guests, explored more Italian luxury and fashion patterns between language collisions, and unlocked the infinite possibility of environmental protection aesthetics.

In the flash space, Yang Yang’s two interactive devices of fun punch in bring new ways of luxury and fashion. Take pictures of Yang Yang’s style at first, and the exclusive 3R kaleidoscope is regarded as handsome and special. In front of the 3R plant wall, Yang Yang planted hogan-3r seed cards, personally unlocked the green thinking of hogan-3r series, and demonstrated the casual style of environmental friendly men.

Hogan-3r environmental protection series flash space takes the iconic green of this series as the background color, and the simulated plants spread on the whole surface of the wall and column; The wall is also decorated with the circular rolling environmental protection declaration of the lamp belt, which highlights the unique identity of the series. In the middle of the space, the marble booth displaying hogan-3r environmental protection series upper luxury shoes and shoes is also refreshed for the special coating of the series: green moss is surrounded around, and the three groups of booths depend on each other. The overall space still inherits the Italian luxury trend, seeks a clever balance between the city and nature, and transmits the original design intention of hogan-3r environmental protection series in a vibrant atmosphere.

The hogan-3r environmental protection series flash space also specially designed two interesting interactive punch points: natural kaleidoscope camera and 3R plant wall. Inspired by the prosperous garden, one of the design inspiration of 3R environmental protection series this season, the camera specially creates a fantastic visual effect of “natural kaleidoscope”; The plant wall with hogan-3r soil cans continues the special ingenuity of hogan-3r environmental protection series: each shoe box of 3R environmental protection series will be accompanied by a seed card, so that greenness and hope can accompany you through autumn and winter.

Hogan-3r environmental protection series inherits the 3R environmental protection principles widely practiced in the world, namely recycle, reuse and reduce. It seeks a clever balance between natural comfort and urban modernity, presenting a unique luxury fashion. Hogan-3r environmental protection series takes the upper luxury shoes that break the shackles of gender as the core, and introduces a variety of ready-made clothes and accessories designed with environmentally friendly and recyclable fabrics, creating an autumn and winter wardrobe with luxury, environmental protection, practical wear and urban sense for urban luxury families.

Hogan-3r environmental protection series has been officially launched in Deji square in autumn and winter 2021. We sincerely invite urban luxury homes to visit the flash space and explore new possibilities of environmental protection and luxury.

“The ‘double carbon’ goal will continue to promote a new round of scientific and technological revolution and industrial reform in China, open up a new model of ‘double carbon economy’ and reshape a new pattern of economic competition and cooperation.” To this end, Zhang Chuanwei, deputy to the National People’s Congress and chairman of Mingyang intelligent, said in an interview with the reporter of Securities Daily that it is suggested to build the first “double carbon” economic demonstration zone in Guangdong, Hong Kong and Macao Dawan district and Cuiheng New District, so as to promote the green and high-quality development of Guangdong, Hong Kong and Macao Dawan district and the agglomeration of industrial elements of “double carbon economy” at home and abroad.

Zhang Chuanwei believes that “the total economy of Guangdong, Hong Kong and Macao Dawan district is 1 / 12 of that of the whole country, and the energy demand is huge. By creating a ‘double carbon economy’ demonstration area, we can drive the localization and greening of regional energy, and ensure the safe supply of energy and structural transformation of the region in the future.”

Zhang Chuanwei said that taking the green development of Dawan District in Guangdong, Hong Kong and Macao as an opportunity, Guangdong Province took the lead in achieving the goal of “carbon peak and carbon neutralization”, created the first “double carbon” economic demonstration zone in Cuiheng new area, Zhongshan City, promoted the connection of high-end equipment, financial capital and carbon economy with the division of labor between Hong Kong and China and international resource factors, and built an international science and innovation center of “double carbon economy”, Make good use of the advantages of basic research of colleges and universities in the region and the industrial transformation advantages of Zhuxi, promote the effective and in-depth integration of “double carbon” innovative technology and innovative finance, and build Cuiheng new area into a “double carbon economy” innovation center, industrial center, high-tech enterprise agglomeration center and a new carrier for the integrated development of “double carbon” industries in Guangdong, Hong Kong and Macao Dawan district is a new engine for high-quality development.

According to Zhang Chuanwei, “double carbon economy” is related to the strategic layout of the world’s future industrial development. Promote the deep integration of new generation information technology and advanced low-carbon technology in Cuiheng new area, drive the rapid development of green and low-carbon manufacturing industries such as new energy, new materials and high-end equipment, and take the lead in cultivating new growth drivers in high-tech, high-efficiency and low emission fields such as equipment manufacturing, clean energy and smart city with great development potential and strong driving force, It is conducive to seizing the international “carbon neutral” technology and industrial highland and gaining greater international “carbon” voice.

“The ‘double carbon economy’ will promote newer and higher-level scientific and technological innovation and industrial reform. It opens up not only a green development path, but also a new model to reshape China’s economic development pattern.” Zhang Chuanwei proposed that the “double carbon economy” will foster and expand the new ecology of low-carbon industries and accelerate the low-carbon transformation in the industrial field. The power grid structure adjustment of “integration of source, network, load and storage” and the deep integration of digital technology and energy system will be the key areas of low-carbon upgrading of energy supply chain in the future, including related technology R & D, equipment manufacturing Professional services and other fields will usher in greater market space.